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ABSTBACT 

The study reported here focused on student outcomes 
and staff perceptions of the educational aspects of the prograns 
funded under Model Cities and Title I of the 1965 Elementary 
Secondary Education Act, In 1966 a Division of Urban Education was 
established. One of the major goals was to improve instruction for 
inner city children. Improvev^ent of communication skills at the 
elementary level was emphasized, particularly in reading. In 
implementing this decision, the Sullivan Programmed Beading Program 
was introduced to the schools in 1968, Beading specialists were 
assigned to each of the 13 elementary schools participating in the 
Title I program. Speech improvement/language development teachers 
were assigned to work with classroom teachers, Paraprof essional aides 
were recruited and trained to help classroom teachers, Resource 
centers were added in some schools, and more audiovisual and 
instructional materials were provided. An expanded in-service 
training program for teachers was mounted. An instructional services 
center to coordinate special services and assist in developing 
educational materials was established. The basic study of program 
impact was to be through comparison of scores of long term students 
in Title I schools. Model Cities schools, and Partial Title I 
schools, both sixth and third grade students. In addition; third 
grade data for all students in 1966 would be compared across 
categories. Within categories, data for 1966 third grade students 
would be compared with 1972 data for evidence of change. Finally, 
evidence of trends would be sought in school average scores for the 
period, 1966 through 1972, (Author/JM) 
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I. SUMMARY 

It is relotively uncommon for documents to begin with a summary. The purpose 
of doing so here is to present, the principal findings of the study and just enough other 
information to make those findings understondoble. It is important that the full report 
be read before using the informotion from this study as a bosis for decisions. 

Leadership of the Division of Urban Education decided to obtain en "outside" 
evaluation of the Title I ond Model Cities progroms ond contracted with the Institute 
for Community Studies to conduct the study. The two basic questions of concern to these 
educators were: 

1. Do students who hove hod extended experience in Title I or Model Cities 
progroms score higher on cognitive ochievement measures than do students 
in comparoble school settings which do not hove such programs? 

2« What attitudes ond reactions do stoff members have to the Title I or Model 
Cities program of which they ore a port? 

Regording the first question, the staff of the Division, led by the Assistant 
Superintenaent, had decided in the beginning to focus program resources on the develop- 
ment of student learning skills with porticular emphasis on reoding. Evaluotion of that 
skill was required. Although informotion on chonges in student self-esteem, ability to 
work with others, ottitudes toword school, and other areos was considered desirable, no 
measures hod been collected in those oreos before or during the program. Therefore, it 
wos necessary to limit the present study of student outcomes to avotlable data, the Iow a 
Tests of Basic Skills (ITB$)o Since these tests are routinely odministered by teochers with 
little or no troining in their. odministrotion, it seems likely that the data ore somewhat 
less comporoble ocross schools ond yeors thon might be destroble. Nonetheless, the tests 
ore welhdeveloped, welhregarded measures which ore widely used and for which national 
norms are ova 1 1 obi e. 

The importance of the second question comes from the belief of Division leadership 
thot teachers ond other stoff had to believe they could make a difference in student out- 
comes in order to make such o difference hoppcn. Informotion on teacher ottitudes would 
indicate whether efforts to establish favorable teacher views of the programs had been 
successful, ond in so doing reflect thot progress toword student outcomes. 

Information regarding teacher ond other staff views of the programs ond their effects 
were obtained from samples of teochers who responded to o relatively limited questionnaire. 
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The basic design of the siody for each question will be described in the informa- 
Hon below regarding that question, 

A, Answers to Question ? 

The study of the impact of the programs on student skills involved two different 
opprooches. The first examined the outcomes for samples of third and sixth grade students 
who hod been students in one of three categories of schools (Title I, Model Cities, or 
PorHol Title I) for 70 percent or more of their "school lives." 

The second approach examined outcomes for all third grade students in those 
schools, regardless of the amount of time they hod spent in the schools. 

I# Analyses of Outcomes for Long Term Students 

The basic study design provided for comparison of achievement scores for sto- 
dents in Title I schools with student scores in both Model Cities and Partial Title I 
schools* Each of these school categories differed from the others in terms of the number 
of years compensatory programs had been in operation^ as well as in the scope and 
specifics or the program. Essentiriily, Title I schools had had the most extensive program 
for the longest period of time, from 1966 until the time the data to be analyzed were 
cotlected, the spring of 1972. Model Cities efforts hod been going forward from 1970 
until 1972. In three of the Partial Title ! schools, some remedial work had been done 
in the 1971-1972 school year. The other two were new to the program in the fall of 
1972. Therefore, compensatory program impact might be expected to be strongest in the 
10 Title I schools, present in the eight Model Cities schools, and absent or nearly absent 
in the five Partial Title I schools. A much more complete description of the programs and 
differences among the three cotegories is provided in the main body of this report. 

To increase the power of the comparisons, only students v;ho had been in o given 
category of school for 70% of their school lives were considered for the analyses. This 
meant that Title I sixth grade students would have been in Title I schools for five of their 
seven (including kindergarten) school years. The same would be true for sixth grade stu- 
dents in the other tv/o categories- Third grade students would have been in the 
schools in a given category for three of their four years. 

One hundred students were selected (using random sample procedures) from those 
eligible for each category at each grade level . 
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a. Data for "Long Term" Sixth Grade Students 

Figure |-1 provides bar graphs comparing the three categories of schools on Vocabu- 
lary, Reoding Comprehension, Language Skills, Work Study Skills, and Arithmetic. T^ie 
first bar in each set represents the mean grade equivalent score for the 100 students in the 
Title I category schools; the second bar does the same for Model Cities; and the third bar 
similarly represents the Partial Title I schools' mean. None of the differences among 
categories were significant . That is, the apparent differences between the mean scores 
for students in the three categories may well be due to chance factors rather than program 
factors. 

There was some concern among District staff and ICS staff that systematic differ- 
ences in student scholastic ability among the categories of schools might bias the results. 
When the data were analyzed to take this possibility into consideration, there still were 
no significant differences among school categories . 

Another factor which, it was thought, might bias the results was the frequency 
with which students moved from school to school. Again, the data were analyzed to take 
this matter into considaratton; and again, no significant differences were found among 
school categories . 

b. Data for "Long Term" Third Grade Students 

Data for 100 "long term* third grade students were analyzed in a similar manner. 
However, since non-Title I schools had administered only the Vocabulary, Reading Com- 
prehension, and Arithmetic scales of the ITBS, comparisons among school categories could 
be made only on those tests. Figure h2 presents the results, Again^ no significant 
differences among categories were founds This finding held when student movement 
among schools and when student non'-verbal iQ were taken into consideration. 

2, Analyses of Outcomes f ur All Third Grade Students 

Before the results of the above analyses were known, it was decided to undertake 
several additional analyses which required that data from all students (not just those who 
hod been in the given school category for 70 percent or more of their school lives) be used. 
School District staff recommended that third grade data be used. Since comparisons were 
to be made with schools other than Title I, only Vocabulary, Reading Comprehension, and 
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Arithmetic data were available. To reduce costs and because major emphasis in the 
Title I ond Model Cities programs was on reading, only Vocabulary and Reading Compre- 
hension data were used* 

Q« Comparisons Among the Three Categories, Using 1972 Data 

Basically the same analysis which was done with long term students was repeated 
with all third grade students* The average Vocabulary and Reading Comprehension scores 
were compared ocross the three categories of schools* The results are shown in the upper 
port of Figure 1-3* 

As indicated there, the differences among school categories for Vocabulary 
scores ore signi ficant . Students in Title I schools have a significontly higher mean 
Vocabulor/ score than do students in either M o del Cities or Partial Title I schools* 
This finding is puzzling. How can it be that there is a significant difference on the 
population when there is no such difference on the sample? The answer lies in the 
number of persons and the way their scores vary about the average (mean) score* In 
this cose, the difference based on groups of 100 is not significant, while approximately 
the sdme aitference on groups of about 500 is significant* 

What are the practical implications of this situation? Basically, it means that 
the differences are quite small • They ore probably real (rather than chance) differences* 
But are they of enough size to satisfy educators concerned with improving the impact of 
schoolmg on youngsters? Such a decision depends upon many factors and will be de" 
cided by each reader. However, some oddiHonal dato analyses are relevant to such 
decisions* 

b* Comparisons Among the Three Categories, Using 1966 Data 

Vocabulary and Reading Comprehension scores for students who were in the third 
grades in these schools in 1966 were retrieved • These were analyzed in the same fashion 
as before* The data ore presented in the lower part of Figure l"3* The difference among 
categories are not significa nt for either Vocabulary or Reading Comprehension* However, 
Vocabulary differences approach significance, and they appear to be in the opposite 
direction from the differences found in the 1972 data. 
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(N=755) 



MCA Partial 
Title I 
{H-857) (N-516) 



2.97 



Title 



Reading 
2.88 



2.87 



MCA 



Portia 
Title I 

(N=518) (N=529) (N=492) 



2.95 



Reading 
2.94 



3.00 



Title 



MCA 



Portia) 
Title I 

(N-757) (N--857) (N-516) 



Fig. 1-3 — Differences Among School Categories on Third Grade ITBS Vocabulary 
and Reading Scores of All Students in 1966 and 1972. 



a. Differences among school categories are significant at the .01 level on 1972 Vocabulary 
scores. 
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c* Comporisons between 1966 and 1972 Within School Category 

To further develop the picture, the mean scores for students who were third graders 
in 1966 in Title I schools were compered with the mean scores for students who were third 
groders in Title I schools in 1972. The same was done for Model Cities and Partial Title \ 
schools. These analyses are shov;n in Figure h4. 

The first Comparisons on the left side of the figure are for Title I schools. The 
smoll "o/' as defined in the note, indicates that third grade students in Title I Schools in 
1972 scored significantly higher on Vocabulary than did their counterparts in 1966. Dif- 
ferences on Reading Comprehension are not significant. 

Looking now ot the middle of the figure, the data indicate that the differences be* 
tween 1966 scores and 1972 scores are not significant for the Model Cities schools. 

Finally, the <^"fferences for Partial Title I schools are significant for both scores. 
However, average scores are lower in 1972. That is, third grade students in those schools 
in 19 72 scored sig nificantl y lower on both Vocabulary and Reading C o mprehension than did 
third grade students in thoso schools in 1966. 

These data suggest that students in schools which have been participating in 
compensatory programs for mciy years may be better off than their predecessors in 1966 
were; that students in schools v/hich have been participating in such programs for about 
two years may be as well off as students were in those schools in 1966; but that students 
in schools which are only starting to participate in such programs may be worse off than 
students were in those schools in 1966. These data do not indicate the extent to which 
changes in student populations or other non-program factors may be involved. 

d. Looking At Trends 

Given the suggestive but not conclusive evidence of change from 1966 to 1972, 
alternative sources of evidence were considered. One of these was trend data for the 
period. District data for the ten Title I schools for Vocabulary and Reading Compre" 
hension were retrieved and charted for the seven years involved. (The charts appear in 
the main body of this report, section III.B.5.) 
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"Eyeballing'* the charted scores suggests more fluctuation ihun trend. For Title I 
third grade students, the overage across schools for Vocabulary (shown by the heavy 
solid line) gives some suggestion of on upward trend, thus supporting the comparison of 
1966 and 1972 overages reported above. Reading scores, on the other hand, ore even 
more difficult to view as indicating a trend. 

The data for Model Cities third grade students ore less complete. The data which 
ore ovoiloble do not evidence a clear trend for either Vocabulary or for Reading. 

The charts also do not show a trend for Partial Title I schools, although the ovoih 
able dote hint that Vocabulary scores ore lower in 1971 and 1972 than they were in 1966 
ond 1969, tending to confirm analyses reported above for 1966 and 1972. 

3. "Adding up" the Results of Student Achievement Analyses 

Trying to put together all the pieces of data for sixth and third grade students is 
not eosy. The sixth grade students do not score differently from school category to 
category. Third grade students in Title I (when all students ore considered) score 
slightly higher on Vocabulary than students in Model Cities and Partial Title f (but not 
when only long term students ore considered). Other comparisons across school categories 
reveal no differences. 

To put such findings into perspective, it may be helpful to consider briefly other 
reseorch on Title I programs operating elsewhere in the nation. Several major analyses 
ond summaries have been completed. One, by Constance Menges and others in the U.S. 
Office of Education, ' concludes that compensatory education is beneficial. However, 
other major analyses come up with contradictory findings. Gloss and others^ analyzed 
data collected in the 1969 Survey of Compensatory Education. On the basis of a non * 
representative sample, but the best data available, he concluded that participants in 
Title I programs hod lower pretest scores, lower posttest scores, and progressed at o slower 
rote than students not in the program. Another major review of Title I evaluations was 



Menges, C., et ol. Th e Effectiveness of Compensatory Education: Summary and 
Review of the Ev>dence~ ^asRTngton, D,C,: Office of Program Planning and Evaluation, 
Office of Education, Department of Health, Education and Welfare, 1V72. 

Glass, G., eta!. Dote Anciysis of the 1968'"69 Survey of Compensatory Educo* 
tion (Title I). Final R^rt . ERIC ^ED 057 146, 1970. 
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conducted by Wargo and others. ' They state in their conclusions^ 

. • • there is little evidence at the national level that the program has had 
any positive impact on eligible and participating cliildren. Data froin state 
and local levels do, however, provide evidence that some Title I projects have 
had a significant positive impact on participating children. . . . 

Given the background of major national evaluations and summaries of evalua"* 
tions which found no differences for participants or even differences indicating 
increasing disadvantage, it is encouraging that in this School District there ore indicor 
tions of improvement. Yet, given significant findings in other local or state programs, 
one might wish for even greater differences. It connof be denied that a third grode 
overage grade equivalent of 3.00 (which is approximately that of the Title I students) 
is still about seven months below norms for the tests. 

In addition, the average Vocabulary and Reading Comprehension scores of all 
third grade students in the 23 schools in these three categories of schools were signifi* 
cantly lower than the average scores of all third grade students in 54 other elementary 
schools (combined) in the School District. 

Perhaps one useful interpretation is that the Title I and Model Cities programs 
seem to be making a positive contribution. An even greater impact is needed, 

B. Answers to Question 2 

School District personnel in each of the three categories of schools (Title I, 
Model Cities, and Partial Title I) were asked to indicate their views in a questionnaire 
concerning the compensatory program with which they were associoted. Questionnaire 
items asked for views concerning program impact upon student achievement, humon and 
material resources, amount and quality of In"Service training provided school staff, and 
impact upon parents and the community. Other questionnaire items elicited District 
staff views concerning implementation of compensatory programs, their attitudes toward 
such educational programs and suggestions and recommendations for changes or modifico* 
tions based upon their experience in them. 



Wargo, M., et oL ESEA Title 1: A Reanolysjs ctkI Synthesis of E^v^ Data 
from Fiscal Yeor l965TR?^gh 1970. Final Report^ ERIC ^ED 0^9 415, lV/2. 
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Since the schools designoted in this report os Portiol Title I ore considered to be 
beginning to implement the Title I progrom, there ore only two progroms, olthough there ore 
three cotegories of teacher respondents. 

Although reading speciolists ond principals ore ossigned to schools, for the purposes 
of this report, they ore generolly grouped across schools. In o similor woy, some centrol 
office stoff work principally with Title I, and others principally with Model Cities; they, 
too, ore in one respondent group. 

This summary focuses moinly on questionnoire items thot reflect District stoff views 
on the results of Title I (Tl) and Model Cities (MC) Programs ond thot indicate ottitudes 
toword these compensatory efforts. In the body of the report thot follows this summory, o 
series of tobies and discussion ore presented which give o brooder and more detoiled coveroge 
of these oreas os well os the others noted obov/e. It should be noted that rother lorge per" 
centoge differences between groups ore required to reoch confidence thot the differences 
ore reol rather than chance. In this report, when stotements ore mode thot o difference 
exists. It is quite likely that the difference is reol. When o stotement is mode thot o dif- 
ference oppears to be present, it is more likely that thot difference is the result of o chonce 
occurrence. 

1 . Perceptions of Student Outcomes 

a. Reading Achievement 

Most School District staff ^ indicated that children's reading skills improved 
to o very great or considerable extent. The percents in each cotegory of school giving 
such responses were: 

78% of Title I respondents (Tl) 

73% of Model Cities respondents (MC) 

51% of Partial Title I respondents (PTI) 

Teachers in Tl ond MC schools more frequently indicated very greot or con* 
sideroble improvement in reoding than did teachers in PTI. 

78% Tl teachers 
71% MC teachers 
42% PTI teochers 



iThis included teochers, principals, reading specialists, other specialists, and 
central office staff. 
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Considering the views of odministrative staff and Reading Specialists, across 
school categories, most indicated that they sovy reading skills improved to a very great or 
considerable extent: 

87% of Reading Specialists 

54% of Principals 

67% of Central Office staff 

b« Other Student Outcomes 

Most District staff indicated that Tl and MC programs hod hod some impact on 
student achievement in each of the six other areas listed in the questionnaire: arithmetic, 
science, thinking, study skills, student's self esteem, and ability to work with others in the 
classroom. 

It appears that more Tl and MC staff indicated substantial improvement in 
certain student outcomes than did PTI staff. Over half of MC staff agreed in assigning 
ratings of very great or considerable improvement to Study Skills and Thinking Ability; 
less than 50% of Tl personnel gave those ratings to those student skills^ 

Title I 

Arithmetic skills (53%) 
Self Esteem (52%) 

Model Citi es 

Ability to work with others (60%) 
Study Skills (57%) 
Thinking (56%) 
Self Esteem (54%) 

Partial Title I 

Less than half of the staff saw such improvement in any skill oreo* 

c. Summary Regarding Perception of Student Outcomes 

Most respondents believe the Title I or Model Cities programs have brought 
about very great or considerable improvement in reading. Most respondents report that 
the programs have brought at least some improvement in arithmetic, science, thinking, 
study skills, self-esteem, and ability to work with others. 
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2, Other Outcomes Perceived by School District Personnel 

a. Outcomes for Teachers and Faculty 

Most respondents expressed the opinion that there had been improvement to o 
very great or considerable extent in teachers" instructional skills, understanding of 
children, and sense of competence* 

56 to 73% of Title I and Model Cities teachers gave such responses 

39 to 50% of Partial Title I teachers so responded. 

71 to 32% of Reoding Specialists. 

50 to 58% of Principals. 

89 to 100% of Central Office staff. 

There were fewer who reported that faculty relationships had improved that 
much. Among tlie various groups^ the percent saying relationships had improved to a very 
great 6r considerable extent were: 

39% of Title I teachers 

56% of Model Cities teachers 

22% of Partial Title I teachers 

65% of Reading Specialists 

^6% of Principals 

78^^ of Central Office staff 

b. Outcomes for Parents and Community 

There was general agreement among teachers that parent and community 
Interest/ support, and participation had not been affected much by the Title I Or Model 
Cities programs. The percent of teachers indicating substantial improvement in these 
areas ranged from 6 per cent to 33 per cent with the lowest percentages found In the 
Partial Title I teocher group. 

Reading Specialists, Principals, and Central Office staff appeared to be 
somewhat more optimistic about the impact on parents, with the percent saying there 
had been improvement to a very great or considerable extent on parent interest, support, 
or participation ranging from 38 to 62. That optimism declined regarding the community, 
the percent so responding ranging from 24 to 46. 
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3« Staff Perceptions of Teacher and Aide Roles 

a* Teccher Activities Seen as Different 

The majority of all teachers, reoding specialists, and administrators indicated 
that Title I and Model Cities programs required some differences in the activities in which 
teachers engaged or in the way activities were done. More principals and central office 
staff indicated differences than did teachers. 

Most Title I teachers reported these differences; 

Continuous pupil progress evaluation 
In-service training participation 

Most Model Cities teachers reported; 

Continuous pupil progress evaluation 
Planning; written objectives 
Use of instructional materials 
Diagnosing and prescribing 
In-service training participation 

Most Partial Title I teachers reported ; 
In-service training participation 

Those results suggest that mo^t teachers in Partial Title 1 schools do not see as many 
differences as teachers in the other two categories of schools, and that Model Cities 
teachers may see most. 

A finding which may surprise some is that reading specialists, principals, and 
central office staff appear more likely than teachers to say that a difference for teachers 
^ in the Title I and Model Cities programs (which means all three categories of schools, 
since Partial Title I is partially implementing Title I) is in receiving continuous super- 
vision* 

b« The Perceived Role of the Classroom Aide 

Most teachers in Title I (62% of teachers with 1 to 3 years in Title I schools 
and 90% of teachers there 4 or more years), and Model Cifles (73%) indicated that they 
had hod, or presently had, a classroom aide. Considerably fewer Partial Title I teachers 
(41%) mdicoted that they had had this kind of assistance in the classroom* 

Teachers in the different categories of schools identified the activities and 
functions that classroom aides were supposed to perform* The most frequently identified 
activities by teachers across categories (60% or more) were; 
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Monitor pupils 

Reinforce instruction 

Set up audio visual equipment 

Make instructional materials available 

Attend to daily routine 

Check test papers 

Teachers who wrote in comments on aides In compensatory programs were 
generally favorable and indicated that aides were important to the teacher in carrying 
out compensotory programs. In responding to a question on the extent to which aides 
did what they were supposed to do, more Title I than Model Cities and Partial Title I 
teachers responded that aides did what was intended for them to do to a very great or 
considerable extent. 

88% Title I teachers 

57% Model Cities teachers 

67% Partial Title I teachers 

It is to be noted that only 15 of the 40 Partial Title I teacher respondents 
expressed views concerning aides. Additionally, while teachers generally were quite 
positive In their views concerning aides, some indicated that their responses were based 
upon good experiences with aides and that their experience had actually varied, with 
some aides doing their intended tasks and others not. Some teachers were crirical of 
aides. 

4. Attitudes of District Staff Toward Compensatory Educational Programs 

a. Title I and Model Cities Programs 

The majority of teacher personnel in each of the three categories expressed 
the view that most teachers after some experience in these programs were favorably 
inclined toward them. 

71% Title I teachers 

73% Model Cities teachers 

51% Partial Title i teachers 

Twenty to 26 percent of teachers across categories indicoted that teachers 
attitudes were neutral, that is, neither favorable or unfavorable. 

Almost one-fourth of Partial Title I teachers (23%) reported that experienced 
teochers were unfavorable or very opposed toward the program in contrast to 9% of Title I 
teochers, and 4% of Model Cities teachers. 
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Principals, reading specialists and central office staff were even more emphatic 
m expressing their views that teachers, after some experience in the programs, were most 
fovorobly inclined toward them. 

83% of Principals 
95% of Reading Specialists 
100% of Central Office staff 

None of these School Dis^rict staff saw teachers as unfavorable or opposed to 
the programs. 

b. Consequences to Students of Discontinuing Such Programs 

A large proportion of teachers indicated that children now participating in 
Title I and Model Cities programs would suffer if such programs were discontinued. 

81% of Title I teachers 

67% of Model Cities teachers 

58% of Partial Title I teachers 

In Title I schools, 15 percent of the teachers felt that discontinuance would 
not affect children now involved very much; and four percent felt that students now involved 
would benefit from discontinuance. 

In Model Cities schools nearly one-fourth of the teachers felt that students 
now involved would not be affected very much by discontinuance of compensatory 
programs. None of the teachers thought they would benefit. 

Principals, reading specialists and central office staff, like the majority of 
teachers, emphasized the negative consequences to students now involved in discontinuing 
such categorical programs for education as Title I and Model Cities: 

77% of Principals 
96% of Reading Specialists 
100% of Central Office staff 

5. Staff Perceptions Cqncerning Eligibility Criteria 

Title I and Partial Title I stoff were asked whether the current policy of gearing 
services to individual student needs was better for children than gearing services to school 
criteria. 
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The majority of Title I and Partial Title I teachers indicated that they felt that gear- 
ing services to individual student criteria was either not as good or was much poorer. 

80% of Title I teachers 

56% of Partial Title 1 teachers 

Partial Title I teachers hod had experience mainly with services directed to indi"" 
vidual students during the year or two that some aspects of the Title I program had been in 
operotion in their schools, so their information on school criteria for services was pre- 
sumably limited. Most Title I teachers had experienced the school criteria arrangement 
over a several year period, and only within the last year had experienced the services for 
individual arrangements. 

Within litle I and particularly within Partial Title I schools there were a number 
of teachers who felt the services for individual arrangement was either better for children 
or about the same as school criteria arrangement. 

20% Title I teachers 

44% Partial Title I teachers 

Title f and Partial Title I principals and reading specialists were emphatic in their 

views concerning "individual" criteria as being either not as good or much poorer than 

school criteria: 

100% of Principals 
81% of Reading Speciolists 

6. Review of Questionnaire Highligh ts 

There is general agreement among respondents that the Title I and Model Cities 
progroms have brought improvement for students In reading to a very great or considerable 
extent. Many reported improvements for students in other areas. Most respondents said 
there had been large improvements for teachers In knowledge and skill. Not nearly so 
many think there have been large imorovements for parents or community in interest^ 
support, or participation. 

Many respondents report that the programs bring changes in the activities of the 
teachers. People who have had aides usually report that they perform six or more supportive 
activities. Comments Indicate some criticism of aides, though the general evaluation is 
favorobte. 
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Most respondents think that persons with experience on the Title I or Model Cities 
programs fovor fhem. Most think fhat discontinuance of the programs would be bad for 
students now in them. While fewer than half (44%) of the Partial Title I teachers think 
that eligibility for Title I assistance being based on individual student need wps not as 
good or much poorer(than basing it on school'-wide student need), 80 percent or more of 
the principals, reading specialists, ond Title I teachers had that opinion. 

Seventy-three percent of all persons who returned useable questionnaires (212) 
stated that the educational programs paid for by the federal government have been good for 
the children. 

C« Summary and Implications 

The "hard data" for student outcomes can be inteipreted to encourage iOiTie hope 
of improvement, but they fail to document consistent better performance of students, 
especially those who hove been in the Title I and Model Cities programs longest. On 
the orher hand, the data for Title I and Model Cities students do not document o down- 
ward trend, which has been true for the total District until recently. 

At the same time, teachers and others who have been actively involved in the 
progroms believe the Title I and Model Cities programs are having an important impact 
on students, as well as improving instructional staff. These educators generally believe 
that discontinuantion of the programs would be detrimental to the students now involved 
in them, 

Christopher Jencks, a Harvard sociologist who has conducted extensive analyses 
of data on educational outcomes, argues that schools need to have the resources which 
teachers believe make a difference, even in the absence of data which demonstrate such 
o difference. He states that the views teachers and students have regarding their work 
situation are that important.' 

The results of this study, as well as many other studies of compensatory programs, 
suggest that no given set of materials or single approach to education will bring improve* 
ment fpr all teachers and all students, and all classroom groups in all school settings. 

'jencks, C, Smith, M., Ackland, H., Bane, M. J., Cohen, D., Gintin, H., 
Heyns, B., AMichelson, 5. Inequality . New York: Basic Books, 1972. 
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Given the openness and commitment evidenced by the leadership of the Division 
of Urbon Education in requesting this study and in accepting the findings, it may well be 
that o different opproach to educational improvement can be evolved which permits and 
promotes greater adaptation to the variety of factors which influence what a given child 
leoms* In the meantime, the views of involved educators, and some indications in the 
ITBS dufa, argue for continuation of the programs. 

In this regard, program development and administrative decisions will be greatly 
facilitated if there is built into this process, continuous evaluation of progress toward the 
most crucial objectives which schools are trying to attain. 

In the present evaluation, there were a number of program objectives that could 
not be directly evaluated because data were not available » Students' self esteem, interest 
In and attitudes toward school, and rote of achievement in various skill areas (for third 
grade students), were some of these. Likewise, for school personnel there was no direct 
evaluation of teachers instructional development or that of other instructional staff result- 
ing from involvement in the programs. Continuous and systematic evaluation in these areas 
over the several years of the programs would hove provided valuable information to deci- 
sion makers, program planners, and implementers. 

The idea of continuous evaluation geared to crucial school objectives implies a 
larger School District evaluation capacity which is closely linked to program development. 
Hord choices of objectives to be evaluated, and careful planning of the evaluation design^ 
should make this effort feasible in terms of costs to the District. Periodic external audits 
could provide additional objectivity and a brooder perspective. Intensive studies of par- 
ticular programs could generate needed unut;iSiun Jiffy of special aspects they are intended 
to provide. 
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Ac Request for the Study 

During the winter of '(972-73, the leadership of the Division of Urban Education 
decided to obtain on evaluation of some aspects of compensatory programs operated by 
the District. They wished to have the evaluation conducted by persons not on the staff 
of the District In order to increase objectivity. Initial discussions with staff of the 
institute for Community Studies led to an agreement to formulate and conduct a study 
focussing on student outcomes and staff perceptions of the educational aspects of the 
Title i and Model Cities programs. 

A number of descriptions of the programs have been written, and the interested 
reader is referred to the Division for fuller explanations.^ A brief description will be 
provided here. In 1966 the School District was reorganized and a Division of Urban 
Education estoblished. One of the major goals wos to improve instruction for inner 
city children. The Assistant Superintendent in charge of this Division at its beginning 
decided to emphasize improvement of communication skills at the elementary level, 
f'orticularly in reading. In implementing t!iis decision, the Sullivan Programmed Read- 
ing Program was selected for use in the early grades; it was introduced to the schools in 
1968. Reading specialists were assigned to each of the 13 elementary schools partici- 
pating in the Title I program. Speech improvement/language development teochers were 
assigned to work with classroofr^ teachers. Paraprofessional aides were recruited and 
trained to help classroom teachers- Resource centers were added in some schools, end 
more audio-visual and instructjolpal materials were provided. An expanded in-service 
training program for teachers was mounted. An instructional services center to coordinate 
special services and assist in developing educational materials was established. 

^Some of the relevant documents are these: 

Wheeler, R. R. Report ort Reading Achievement in the Division of Urban 
Ed ucation, ]9"56To 197Q o Kansas City, Mo,; The School District of 
Kansas City, Mo. 

. A General Overview of Needed Innercity Educational Measures ^ 

Kansas City, Mo»: The School District of Kansas City, Mo. 
Division of Urban Education, School District of Kansas City, Mo. Uplift 1968 . 

Kansas City, Mo.: The School District of Kansas City, Mo.^ IVbtJ. 
. The Division of Urban Education o Kansas City, Mo.; The School 

District of Kansas City, Mo., 1972, 
Webster/McGraw-Hi 1 1 . Research Report 2: Programmed Reading, An Exemplary 

Project. New York: McGraw- 




In the fall of 1969 preporations began to mount an educational improvement 
effort with funds from the Model Cities program. Although arrangements did not move 
OS rapidly as intended, a number of the elements of the Title I program were initiated 
In eight odditional elementary schools in the fall of 1970. The Sullivan program was 
Introduced (in seven of the eight schools), although materials were short. Some aides 
were recruited ond introduced during that school year, and more were added the sub- 
sequent year. In three schools EDL Reading Laboratories were added. The emphasis 
was on the kindergarten through grode three years in those efforts supported by 
Model Cities. 

Title I funds, ovailable from the federal government, are distributed to schools 
within the District on the bcsis of demonstrated educotional and financiol needs. In the 
earliest years of School District participotion in the program, 13 schools were determined 
by District staff to be most qualified, and were involved in the Title I program. In 1972, 
ten of the original 13 were still involved. In oddition, several other schools had become 
eligible for participotion. Three of the schools which were not previously involved re- 
ceived some osslstonce which was principally used for remediation of reading problems 
in the 1971-72 school year. Since the volume of compensatory assistance was small thot 
year ond concentrated in the early grades, it is unlikely to have had measurable impact 
on third grade students and was considered non-existent at the sixth grade level. These 
schooU ore referred to in this report as Partial Title I. 

The three*groups, or cotegories, of schools described in the poragraphs above 
are, in 1973, receiving some form of compensotory assistance to improve the educotional 
progrom offered the students. For purposes of the study, however, the differences among 
them permit evaluotion of the impoct of compensotory programs. In the next secHon of 
the report, the way the evaluation was performed is described. 

B. Research Plons and Design 

In the course of discussions with staff of the Division of Urban Education, two 
salient questions were identified far study: 

Do students who have had extended experience in Title I or Model Cities 
progroms score higher on cognitive achievement measures than do students 
in comparable school settings which do not have such programs? 

Whot otfltudes ond reactions do staff members have to the Title I or Model 
Cities program of which they ore a port? 
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in this port of the report, the procedures used to answer those questions will be 
orgonized in two sections, one for each question: Student Outcomes and School District 
Staff Perceptions • 

1 . Student Outcomes 

a. Analyses of Long-Term Students 
(1) General Design Considerations 

Although some interest was expressed in impacts which the programs may hove 
hod on teachers, other staff, resources, and the organization and procedures of the 
District, most concern was focussed on student outcomes. From the beginning of the 
program, student emotional and socio! development had been objectives. However^ 
emphasis had been clearly laid on cognitive outcomes, the learning skills. In the words 
of the first Assistant Superintendent of the Division, . . the development of rcoding 
skill ond language facility wo'i assigned the highest priority." ^ 

Staff of the Division were interested, therefor?, in having the evaluation 
determine whether students in the Title I program demonstrated higher reading skills and 
other cognitive skills. They were especially interested in the outcomes for students who 
hod been in the program for extended periods of time. It was agreed that -^ata selected 
for study would be on students who had been in the program for 70% or more of their school 
years. The question actually studied might be phrased 'What ore the impacts of the Title I 
and Model Cities programs on the cognitive skills of long term students in those schools?" 

Outcome data for 1972 were selected for analysis. In that yeor, sixth grade stu- 
dents in Title I schools hod the potential of having been in the program from its inception 
in 1966. 

Cognitive achievement data are routinely collected by the School District from 
students m the third and sixth grade • The data collection instrument used is the Iowa Tests 
of Basic Skills (ITBS). These instruments were carefully developed by qualified experts. 
However, they depend a great deal on the administrator carefully following specific in- 
S;iuCiion>. The District depends upon teachers to administer the tests. Under existing 
circumstances, many factors may bring bias into the scores obtained. Teachers may not 
have the knowledge, skill, or experience which provide the precise administration 



Wheeler, R. R. R eport on Reading Achievement in the Division of Urbon 
Education, 1966 to 1970 . Mimeo. Kansas City, Mo.: The School District of Konsos 
^ City, Mo. 
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required. Unconscious foctors may also have on effect. Teachers ore oware that some* 
one, somewhere, may consider the test results in their performonce evaluation • They 
olso are owore thot the test results have some impoct on the? allocation of Title I funds. 
To sum up, there is on unknown amount of "noise" or bios in the ITBS data for the District* 
Given the post hoc nature of this study and its financial limitations, the available ITBS 
data hod to be used. The some form of the ITBS was used during the years 1966 through 
1972. 

To permit a better basis for studying program impact, comparison students were 
ftotight. Schools in which students come from roughly comparable socio-economic status 
were identified as those receiving Model Cities osslstonce ond, in recent years, five 
other schools. These latter five were just beginning to participate in the Title I pro- 
grom. Most began in the 1972-73 school year, which was subsequent to the spring, 
1972, data collection which //s used in this study. These three sets of schools provided 
the basis for three"way comparisons to permit the analysis of the impact of compensatory 
programs, as will be spelled out in the next several paragraphs. 

In t^e spring of 1972, sixth grade students in Title I schools could hove partici- 
pafed in the Title I program during all of the time that it was implemented in the District. 
Sixth grade students in Model Cities schools would probably hcm^ not been affected at 
all by that program because it was not initiated until the fall of 1970 and was concen- 
trated in the early grodes. Students in the sixth grade in 1972 in Partial Title 1 schools 
would hove hod no effects of such compensotory programs. The three-way compc/risons 
omong these schools at the sixth grade therefore provide?, two groups which had, essen- 
tially, hod no compensatory program ond the Title I students which hod been in that pro- 
gram. 

At the third grode level, a different sirLdtion existed In the spring of 1972. The 
Title ! third graders hod the possibility of hov'mg been in Title I programs all their school 
lives* The third grode students In Model Cities schools could hove received the help of 
the progrom for tv'O years, 1970-1972. In the Partial Title I schools, most third graders 
would hove received no help from the progroms. Thus, Title 1 students might have re- 
ceived most help, Model Cities students might hove received two years worth, and Partial 
Title I students very little or none. Comparisons could reveal the differential effects of 
the three levels of input. 
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Studying oil of the students in the 23 relevont elementary schools v/os deemed 
rr>uch too lorge o task for the resources. The decision wo* mn^-^o *c f:<:b3 on third crid 
sixth grode students, since ITBS doto were ovoiloble ond those gfodcs provided good com- 
porisons, given the length of time the Title I and Model Cities progroms hod been in 
operotion. 

(2) Specific Design Decisions Regording the Bosic Anolysis 

Considerotion wos given to vorious wo/s of ossessing progrom impoct in order to 
make comporisons» Most ottroctive wos some meosure of gain or of performonce In 1972 
which wos different from whot eorlier ir^dicotions would hove predicted. It was thought 
rtiot doto on very eorly school ochievement, or on very eorly indications of obilify to legm 
(IQ), might be used to predict outcomes through regression procedures. Then variotion of 
predicted scores from octual scores could be studied ocross the three cotegories of schools* 
However, no standardized measures liau been collected on students in oil schools prior to 
the third grode. It wos believed thot by that time p<ogram effects would hove taken place. 
To use doto collected ofter the program hod hod on impoct to moke predictions would dis'" 
tort rhe analysis, so this procedure was not used. 

Therefore, it become necessary to use o post only, comporison groups design* 
That is, 1972 ITBS doto for students in the three cotegories of schools would be compered* 
To promote the power of the anolysis ond reduce costs of doto retrieval, it wos decided 
to perform the onolyses on data from 100 students from eoch cotegory of school ot each 
grade level* Student selection processes will be described \n the next subsection of the 
report, which is headed. Selection of Student Data* 

The basic study design is represented in the table below. 



25 



Toble 

Comparison of I TBS Scores for Long Term Students 
in Three Categories of Schools 



ITBS 

Scores 


Ti»le 1 
Schools 


Model 
Cities 
Schools 


Partial 
Title 1 
Schools 


1 


0 






2 








3 








4 








5 









^Data from 100 students in eoch eel I of the table. 



In the discussions between staff members of the Division of Urban Education and 
staff of the Institute for Community Studies, various factors which might mask or dis- 
tort comparisons among the three categories of schools were considered. One was the 
possibility that learning ability might be different In one group than another. After 
reviewing the controversy of recent years regarding the meaning and use of IQ measures. 
Division staff expressed o desire that non-verbal IQ measures be used in part of the 
onalysis to be sure differences in learning ability did not distort the meaning of the re- 
sults. Such data were obtained from test records. 

Another factor which was discussed was student movement from one school to 
another. Division staff reported that there was a great deal of movement of families with- 
in the inner^ity area. This movement presented students and teachers with the difficulties 
of constantly learning new needs and new groups or^d new procedures, thus reducing 
the time and energy for working on the cognitive objectives. Since such student move- 
ment might be quite different from one school category to another, it was decided to 
check this factor in the analysis. Therefore, data were obtained from the cumulative 
cards on the number of times students moved from one school in the District to another. 
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(3) Selection of Student Data 

In this section of the report, fhe process ond rationale for selecfmq a sample 
of students whose data would be used in the analysis are explained. Three criteria 
were applied to select the pool of stu^Jents from which the final samples were selected: 
(1) exposure to the educotionol program of o given category of school; (2) availobilit/ 
of Iowa Tests of Basic Skills (ITBS) -Jata; and (3) availability of IQ data. 

As discussed above^ to provide a better opportunity to assess the impact of the 
Title I and Model Cities programs, it was decided to select youngsters who had been in 
one or onother school in a given school category for at least 70% of the lime they could 
have been in school. Thus, for a sixth grode student to be considered as in the Title I 
Program, he would have hod to have spent five of his seven years in one of the ten 
clementory schools still participating in the program In the spring of 1972 which ^)ad 
been participating since the beginning. Simiiarly, sixth grade students in the com" 
parison schools identified as Model Cities would have had to have been in one of the 
eight schools (which hod participated in that program from 1970 through 1972) for five 
of the seven years. The same would be true for the comparison schools that are re" 
ferred to as Partial Title I schools. 

The requirement for third grade students to be included in the stuc'/ was that 
they had been in one of the schools in a given category for three of the four years 
that they were in school. 

In addition, each student had to have been in school 70% of the time for 
each of the years that he was considered in the program. 

Since the analysis of student outcomes had to be bosed on already available 
data, the population of students who might be included in the analyses had to have 
completed the Iowa Tests of Basic Skills (ITBS) in the spring of 1972. 

Since it has been decided to use non**verbal IQ data in the analyses, it was 
necessary to retrieve those data on the population of students. A number of students 
did not have IQ data, and they were therefore eliminated from the sample pool. The 
measure used for sixth grode students hod been administered in the fifth grade; that for 
third graders hod been odministered during their third grade year. 
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To review, the pool of students from which the final samples were drawn were 
those students who (1) had been in the program for 70% of their school experience, 
(2) had data available on the Iowa Tests of Basic Skills for all tests to be used for their 
grode level, and (3) hod non"verbal IQ data available. As a consequence, approxi- 
mately 71% of the sixth grade population was eliminated, and approximately 65% of the 
third grade population was eliminated. Such a reduction obviously raises the question 
of what kind of bios has been introduced by such selection processes. It seems cleor that 
students in the analysis are those students who come from relatively non'^mobile families* 
Although students could have moved from one school to another with a fair degree of 
frequency, they did have to remain within those areas served by the schools in their 
porticular progrom. In addition, many of those students who are ill often or intensely dislike 
school were also eliminated by the requirement that they be in attendance 70% of each 
school year. Additionally, the fact that all of the data were available for the students 
to be studied means that they attended regularly and were willing to respond to the 
intelligence and achievement measures. 

Th» remaining groups of students in each school category and grade level varied 
in number, ranging from about 165 to obout 265. To facilitate the analysis, it was decided 
to have 100 students for each school category for each grade level • Students were, there- 
fore, deleted according to random sample procedures to approximate 100 in eaCh of the cate- 
gories. Information regarding numbers of students at each stage in the sampling process is 
shown in Table ll*"2. 

The final son-ple is approximately 15% of the population of students in those two 
grodes in the 23 schools. 
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Table 11-2 
Studenf Dofa Sample 





Number on 

• ~ ill \^ 9 \^ 1 1 

Attendance 

Rosters 

(Popula^ion) 


Number Meet— 
ing Selection 
Criteria 
(Eligible) 


Students Selected 




N 


Percent of 
Population 


Percent of 
Eligible 


Sixth Grade 












Title 1 


731 


210 


100 


13.7% 


47.6% 


Model Cities 


720 


215 


100 


13.9% 


46.5% 


Partial Title 1 


580 


166 


100 


17.2% 


60.2P/O 


Total in 

23 Schools 


2,031 


591 


300 


1 A on/ 

14.8% 


50.8% 


Third Grade 












Title 1 


701 


223 


100 


M.3% 


44.8% 


Model Cities 


680 


268 


100 


14.7% 


37.3% 


Partial Title ! 


624 


207 


100 


16.0% 


48.3% 


Total in 
23 Schools 


2,005 


698 


300 


\ci no/ 


43.0% 
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h. Additional Studies Utilizing ALL Third Grade Students 



(1) Comparison of 1972 Data Across School Categories 

As the result of a variety of considerations, it was decided to repeat the basic 
onclyses with third grade students, this time using the Vocabulary and Reading Compre** 
hension data available on all students in the 23 schools at the time of testing in the 
Spring of 1972, regardless of the amount of time spent in any given school rr category 
of school* This provided a check on the similarity of the sample to the population. 

(2) Examination of Evidence of Change Over Time 

Despite earKer decisions to relinquish studying change (because of the pre 
hibitive cost of retrieving data for students who would have fit the criterion of 70% 
of their school years in a given category), the interest in obtaining some indication of 
change continued. As a result, it wos decided to obtain data on all students who were 
In the third grade in the 23 schools in the spring of 1966. Such data permitted com* 
porisons among the three categories In 1966 and comparisons within categories between 
1966 and 1972. It should be noted that chonges in the socioeconomic level and other 
characteristics of the families living in a given school district (or of a set of schools 
comprising one of the categories) may be the determining factors for any differences 
which might appear between the two years ^ thus changing any program impact* 

An additional, quite limited, study was pursued, that cf charting and examining 
the available school average scores for each of the 23 schools over the period 1966 
through 1972. Such on examination was expected to reveal strong or consistent trends. 

c# Summary of Research Plans and Design for Student Outcomes 

The basic study of program impact was to be through comparison of scores of 
long term students in each of the three categories of schools, both sixth and third grade 
students. 

In oddition, third grade data for all students in 1966 would be compared across 
categories. Within categories, data for 1966 third grade students would be compared 
with 1972 data for evidence of change. 

Finally, evidence of trends would be sought in school average scores for the 
period, 1966 through 1972. 
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im School District S taff Percep fiofU and Attitudes Recjarding the Programs 
a* Questionnaire Design 

With regord to the second question (What are the reactions of teochers and 
other staff to the programs?), a questionnaire study was designed to elicit from School 
District personnel their views rega?*ding four areas: (1) effects of the programs on stu* 
dents, School District staff, and parent and community involvement with the schools; 
(2) program and other factors thought likely to bring about those effects; (3) factors 
affecting program Implementation; and (4) compensatory programs generally. 

Most of the questionnaire items were of the "closed end" variety, for which 
alternative answers are provided, and the respondent marks the alternaHve of his choice. 
Some of the items asked respondents to write in their own answer. On many items, 
space was provided for additional comments vvhich respondents might wish to moke. 

Although there were three cctegories of schools, there were only two programs. 
Title I and Model Cities. Therefore, the Title I and Partial Title t personnel responded 
to exactly the some questionnaire. The questionnaire used with Model Cities staff was 
very nearly the same; in most cases only the referent. Model Cities, was changed* 
Copies of the questionnaire ore included as Appendix A. 

b. Selection of School District'Staff for Questionnaire Sampl e 

To provide a variety of viewpoints, the questionnaire was distributed to teachers, 
reading specialists in the schools, other in-school specialists, principals, central office 
specialists, and centra! office odministrators related to those schools* All reading 
specialists, all principals, and all central office staff were provided questionnaires. 
Samples of teachers were selected from each of the three categories of schools. In Title 
i schools, teachers were selected if they were eligible for Title I assistance in 1973 and 
were teaching in regular classes (not special education, industrial arts, or homemaking). 
Eligibility for assistance was determined by the School District on the basis of economic 
and educational disodvontogement of the children in a given class. The amount of dis"* 
odvontogement determined the amount of assistance.) Experience in other teoching 
settings did not influence selection for the Title I sample* 

[n Model Cities schools, all teachers of regular classes whose teaching experience 
during the years 1966-1973 was reported to have been only in Model Cities schools were 
selected. This wcs done to insure that the smaller number of teachers who would be 
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selected would be informed about the Model Cities program and be responding with 
experience in those schools. The actual sample included one teacher with one yearns 
experience in a Title I school six years before and another v/ith three years* experience 
tcD PTI schools prior to three years in MC, 

In Partial Title I schools, all teachers of regular classes who were eligible for 
ossistonce and whose teaching experience during the period 1966-1972 was reported to 
hovejbeen only in Partial Title I schools were selected. The actual somple included one 
teacher who subsirituted one year in an MC school and another who tough* one summer in 
on MC school during the period 1966 through May, 1972. 

Table 11-3 shows the number of completed questionnaires returned in comparison 
with the total number of teachers shown in the School District Directory, the number of 
teaching experience forms returned, and the number of questionnaires distributed. The 
teaching experience forms were distributed to teachers in the 23 schools involved and 
requested information on school and grade taught in during the years 1963 through 1972, 
since the school taught in in 1973 was known. The total number of questionnaires dis- 
tributed to teachers, specialists, and administrators was 271 • The total number completed 
and returned was 212, giving a return rate of 78%, 



Table l|-3 

Questionnaire Return Rate for Teachers and In-School Specialists 



School 
Category 


Number of 

Teachers 

and 

Specialists 


Number of 

Teaching 

Experience 

Forms 

Returned 


Number of 
Question- 
naires 
Distributed 


Number of 
Completed 
Question- 
naires 
Returned 


Completed 
as Percent of 
Distributed 


Title 1 


201 


188 


113 


82 


73% 


Model Cities 


150 


114 


61 


54 


89% 


Partial Title f 


144 


114 


61 


47 


77% 
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III. ANALYSIS OF STUDENT OUTCOMES 

A* Data Analyses for S i xth Grade Students 

1 • Results for "Long Term** Sixth Grade Students 

a. Student Selection and Data Retrieval Procedures 

As explained above, it was decided to analyze cognitive achievement 
data for students who had been in the programs approximately 70% of their school lives. 
For sixth graders, this meant that they hod to have been in one of the schools in the 
category of schools in which they completed the sixth grade for five or more years. 
Through careful examination of cumulative records, it was possible to identify such 
studentSu Scores were obtained for these students on the Iowa Tests of Basic Skills and 
from the Lorge"Thorndike Intelligence Test, Data were also obtained from cumulative 
records regarding the number of different schools in the Kansas City system which the 
student had been in and what fila family situation was (that is, whether he was living 
with both parents, one parent, etc •) • 

When all of the eligible students for a given school were identified, the 
total number of students for all the schools in that category was determined. A sampling 
ratio was determined which would provide a total of slightly over 100 students for that 
category. Using that ratio, students were selected from each of the schoi^Ii to obtain the 
sample for that category. Following final checks, a few students were randomly deleted 
to produce a total of 100 students in each of the school categories. 

It was decided to use multivariate analysis of variance procedures which 
would permit testing whether there were differences among the categories of schools 
when examining all of the ITBS scores at one time. The outcome variables for sixth 
grade students were Vocabulary, Reading, Language, Work Study, and Arithmetic • 

b. Results of Comparisons Among School Categories 

The first major test was conducted comparing the basic grade equivalent 
scores which are summarized in the first three columns of Table 111*1 • The mean scores 
for the 100 students in each category are presented for five ITBS scores. The statistical 
test applied (multivariate analysis of variance) indicated that none of the three cate- 
gories (Title I, Model Cities, or Partial Title I) differed significantly from each other. 
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Earlier discussion with staff of the Kansas City School District had indi- 
cated that high student mobility wf hin a limited geographic area is often a source of 
difficulty for teachers and the students. Information on the number of times a student 
changed schools within the District was obtained • This factor was taken into con- 
sideration (through covariance), and the analysis was re-'run. The student mean scores 
adjusted for this factor are presented in the middle three columns of Table llhl. None 
of the differences among the three school categories were significant. 

Discussion with District staff also brought out concern as to whether student 
ability variation from one school category to another might hide or distort the actual 
effects the programs are having. Although there is controversy about the measurement 
of "innate learning ability, " measures providing IQ scores are often used as evidence 
of obiiity to learn. Because ruch measures may be culturally biased — especially verbcl 
measures, staff of the School District suggested that the non""verbal score on the Lorge- 
Thorndike be used. 

The final three columns of Table III"! present the student mean scores 
adjusted for I.Q. for each school category. These scores provided the basis for another 
analysis to determine whether there were differences among the school categories. 
Again, no differences were significant. 

Thus, analyses based on these student samples indicate that there is not 
clear end persuasive evidence that differences in scores arise among sixth grade students 
who have been in Title I, Model Cities, or Partial Title I schools for most of their school 
career. 

Because much emphasis in the Title I program was placed on Reading, the 
data regarding that outcome were especially scrutinized. The means in Table lll-l on 
Reading consistently show the students in Title I schools to have the apparent highest 
mean. This is different from each of the other ITBS measures. On the other measures, 
the Title I students appear to be lower than one of the other groups on some comparison. 
While this observation about Reading scores is only impressionistic, it is suggestive of 
some program impact on that skill. 
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c« Family Situation Analysis 

Another factor which seems likely to influence student achievement, 
although it is o factor that is mainly outside of the influence of the school, is the child*s 
family situation. U wos thought that there might be a higher proportion of students with 
difficult family situations in one category of school or another which could distort the 
results of the present study. Information was obtained from the cumulative records indi- 
cating *rfhe\her the student lived with both parents, one parent, or had some other family 
situotion. Two comparisons were made. The first was between scores of students who 
live with both parents and the scores of students who live with one parent^ one parent 
and Q sfep-*parent, aunts, uncles, grandparents, or guardians. The second comparison 
was between the scores of students who live with both pcrents and the scores of students 
who live with their mother. (Nearly all of the students lived with either both parents 
or with their mother. The analysis was run on the two comparisons just described because 
the limited number living with grandparents, etc., made a three-way comparison in- 
appropriate.) 

In these comparisons, the analysis again was done to study differences 
amoncj the three categories of schools on student outcomes on the ITBS*. None of the 
differences were significant between students with both parents and studenh with other 
family situations. Tables 1 1 1-2 and 1 11-3 present the means for both sets of comparisons. 
Both td>les reflect the parent favorable impact of living with both parents. However, 
the small size of the differences and the variation within each Family Situation category 
mean that the differences may well be chance differences. 

2> Results of Examining Trend Charts for Title I Schools 

The average student scores for each Title I school for Vocabulary and Read- 
ing Comprehension were charted for the years 1966 through 1972. These charts are 
shown in Figures 111-1 and 111-2 . Visual examination suggests that clear trends in 
the data are not evident. Fluctuations for any given school over the years are generally 
quite large, much larger than any chonge in the average for the 10 schools combined. 
Arbitrarily selecting the years 1966, 1969, and 1972, the following observations (not 
statistically-supported analyses) could be mode. Reading comprehension scores in 1972 
oppear to be lower in 8 schools than in 1966, and the same is true for comparison with 
1969. Vocabulary scores in 1972 were lower than in 1966 in six schools; such scores 
in 1972 were higher than in 1969 in five of the schools, and lower in five. 

The broad, solid line shows the average score for all students in the 10 schools. No 
clear trend appeors^ although the over-al! average does appear more stable in recent years. 
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Toble III-2 

Averoge Scores of Sixth Grade Sfudents on the Iowa Tests of Basic Skills 
by Fomily Situation, Both Parents Compared With Any Other^ 









Averoge 


Scores 








Title 


1 


Model Cities 


Portial 


Title 1 


ITBS Scores 


Both 


Any 


Both 


Any 


Both 


Any 




Porents 


Other 


Parents 


Other 


Parents 


Other 




(N=43) 


(N-53) 


(N=65) 


{N=30) 


(N=60) 


(N=36) 


Vocobulory 


5.37 


5.01 


5.21 


5.17 


5.15 


4.69 


Reading Comp. 


5.37 


5.31 


5.02 


5.14 


5.15 


4.77 


Longuoge 


5.33 


5.44 


5.26 


5.02 


5.35 


4.89 


Work Study 


5.41 


5.4] 


5.40 


5.39 


5.29 


5.01 


Arithmetic 


5.39 


5.35 


5.41 


5.26 


5.42 


5.06 



^Pother only, mother only, guardian, grandparents, uncle, aunt, one 
porent and o step"parent. 



Table lll"3 

Averoge Scores of Sixth Grade Students on the lowo Tests of Basic Skills 
by Family Situation, Both Porents Compared With Mother Only 









Averoge 


Scores 








Title 


1 


Model Cities 


Partial Title 1 


ITBS Scores 


Both 

Parents 

(N=43) 


Mother 

Only 

(N=46) 


Both 
Parents 

(N=65) 


Mother 

Only 

(N=22) 


Both 
Parents 

(N=60) 


Mother 

Only 

(N=23) 


Vocobulory 
Reoding Comp. 
Longuage 
Work Study 
Airthmetic 


5.37 
5.37 
5.33 
5.41 
5.39 


5.04 
5.26 
5.53 
5.35 
5.29 


5.21 

5.02 

5.26 

5.40. 

5.41 


4.92 
4.83 
4.78 
5.17 
5.17 


5.15 
5.15 
5.35 
5.29 
5.42 


4.65 
4.76 
4.84 
4.98 
5.08 
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• 

«.7 



6.6 
6.5 
6.4 
6.3 
6.2 
6.1 




3» Summory for Sixth Grode Students 

ITBS scores, non-verbal IQ scores, end certain other data regarding mobility 
and fomily situation were obtained fox sixth grade students who hod spent five years in 
one of the^Cpllowing school cotegories: Title I, Model Cities, and Partial Title L 
Differences ombng scores of students in the three categories were examined, and none 
were found to be statistically significant. This finding held when student differences 
•n the number of school moves and non-verbal IQ were taken into consideration. While 
mecn scores of Title I students were consistently apparently higher on Reading, those 
differences did not approach statistical significance ond therefore m.oy be due to chonce. 
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B« Results of Analyses for Third Grade Sfudents 



The anal/sis of third grode data was more complex than that for sixth grade 
students* It will be reported in fhe following subsections: 

1 . Results for Long Verm Grade Students 

2. Results for Populations of Third Grade Students, 1972 Data 

3. Results for Populations of Third Grade Students, 1966 and 1972 Doto 

4. Results for School Averages, 1972 Data 

5. Results of Trend Studies 

6. Summary of Data for Third Grade Students 



1 . Results for Long Term Third Grade Students 

o. Student Selection and Data Retrieval Procedures; Analysis Outline 

Procedures for selection of the third grode sample were similar to those 
used in selection of the sixth grade group. To be included in the sample a student 
must hove attended schools in one of the three sets of categories (Title I, Model Cities 
or Partial Title I) for at least three of his four school years. It was the genera! opinion 
of the $taff of the Division of Urban Education that a student who had been exposed to 
a particular program for 70% of his school time should be affected by that program. 
(Hopefully, program results would be discernible in his recorded test performance.) A 
final sample of 300 third-grade students was obtained, 100 in each category of schools 
mentioned above. 

Scores were obtained for the students in the sample on the Iowa Tests of 
Basic Skills (ITBS) and from the Lorge-Thorndi ke Intelligence Test (L-T). Only three 
of the sections of the ITBS are administered to third graders in all the schools in the 
District: Vocabulary, Reading and Arithmetic. These three scores plus the Lorge* 
Thorndike non-verbal !Q score were the measures used in statistical comparisons. 

Data were also obtained on the number of moves the student made firorri 
school to school within the district. 
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b« Results of Comparisons Among School Categories 

A major thrust of the Title I program has been toward improvement of 
reoding obilify* As described in section II (Background) of this report^ there were dif- 
ferences among the reading programs in the three categories of schools, perhaps the 
most visible one being the use of the Sullivan Reading program in the Title I schools 
and more recently in the Model Cities schools. 

The Titfe I program had been in operation for the full length of the 
"school lives" of third grade students who attended them, and the Sullivan program 
hod been in use during that time. Model Cities schools had been receiving assistance 
from the fall of 1970 through the spring of 1972, when the data were originally 
collected on student outcomes. The Sullivan program was initiated in seven of the 
eight schools, although materials were late in arriving in the classrooms. Clossroom 
aides, also late, were introduced into Grades 1 and 2. In three of the schools having 
Sullivan materials, EDL reading laboratories were established. Partial Title I schools 
continued with the Scott, Foresman program. 

The comparisons among the three categories of schools on third grade 
student outcomes were made using the same procedures as were used with sixth f;;ade 
students. The mean scores for the three tests are presented in Table 111*4 . Tho first 
analysis examined the regular grade equivalent scores which appear in the leff f^art of 
fhe table. Although the mean scores of Title I students appear to be h?gher, there h 
not a significant difference. 

To test whether differences in student movement among schools might 
affect differences among school categories, this factor was taken into account (through 
covariance procedures). The analysis was run, and no significant differences among 
categories were found.. (The mean scores adjusted for this factor appear in the middle 
of Table III- 4 .) 

To determine whether learning ability as represented by non-verbal IQ 
scores might affect differences among school categories, this factor was taken into con- 
sideration (through covariance), and the analysis run. Again, no significant difference 
was found. (Adjusted mean scores are reported on the right side of Table III" 4 ^) 
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c# Fomily Situation Analysis 

As with sixth grade students, information was obtained indicating whether 
these third grade students lived with one or both parents or in some other family situa*' 
tion* The onaiysis indicated that differences among school categories are hot affected 
by these considerations. There are no differences among categories when family situa- 
tion is taken into consideration. (Tables III-5 and III-6 present the mean scores involved 
in these comparisons.) 

d* Summary of Analyses for " Lo ng Term" Third Grade Students 

None of the comparisons among the three programs identified any sig- 
nificant differences on ITBS scores for "long term" third grade students. This basic find- 
ing remained true when student moves (omong schools) was considered, when non-verbal 
IQ wos considered, and when family situation was considered, 

2. Results for the Populations of Third Grade Students, 1972 Data 

u. Data Retrieved 

Although the initial intent of the study was to examine outcomes for 
"long term" students, it was deemed desirable to have some basis for checking those out- 
comes with some outcomes for all students in those schools at one of the grade levels* 
Prior to the analysis of data for "long term" students, it was decided to retrieve Vocabulary 
and Reading Comprehension data for all third grade students in the 23 schools involved. 
An additional comparison was suggested in the form of '*all other" elementary schools. 

Data on means, numbers of students, and standard deviations were retrle^/ed 
from test records for the 10 Title I schools, eight Model Cities schools, five Partial Title I 
schools, and 54 ether elementary schools. (Among the 54 was one which had become part 
of Title I prior to 1972 but had been eliminated from that group in order to have students 
with !ong tenure.) 

b. Results of Comparisons A m ong Three School Categori es 

Using data from all students in the Title I, Model Cities, and Partial Title I 
third grades, comparisons were mode across school categories on the mean scores for 
Vocabulary and Reading Comprehension. These dota are in Table in~7. 
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Table III-5 



Average Scores of Third Grade Students on the Iowa Tests of Basic Skills 
by Family Situation, Both Parents Compared With Any Other° 



Average Scores 

Title 1 Model Cities Partial Title I 

ITBS Scores Both Anv Both Any Both Any 

Parents Other Parents Otner Parents Otner 
(N=42) (N=54) (N=51) (N=44) (N=72) (N=21) 

Vocabulary 3.10 2.91 2.83 2.87 2.86 2.74 

Reading Comp. 2.97 3.01 2.94 2.92 2.97 2.90 

Arithmetic 3.15 3.06 2.98 2.96 3.10 2.86 



^Father only, mother only, guardian, grandparents, uncle, aont, one 
parent and a step-parent. 



Table III-6 

Average Scores of Third Grade Students on the Iowa Tests of Basic Skills 
by Family Situation, Both Parents Compared With Mother Only 



A verage Scores 

Title 1 Model Cities Partial Title I 

ITBS Scores Both Mother Both Mother Both Mother 

Parents Only Parents Only Parents Only 
(N=42) (N=48) (N=51) • (N=38) (N=72) (N=17) 

Vocabulary 3.10 2.95 2.83 2.92 2.86 2.72 

Reading Comp. 2.97 3.01 2.94 2.93 2.97 2.89 

Arithmetic 3.15 3.12 2.98 3.01 3.10 2.82 
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Table 111-7 



1972 ITBS Vocabulary and Reading Comprehension Data for Ail Third Grade Students 

in Four Categories of Schools. 

Vocabulary 







Model 


Partial 


All 




Title 1 


Cities 


Title 1 




Number of Students 


516 


529 


495 


3,607 


Average Score 


2.97 


2.82 


2.76 


3.31 


Stondord Deviation 


.874 


.906 


.883 


1.00 



Reading 







Model 


Partial 


All 




Title 1 


Cities 


Title 1 • 


Others 


Number of Students 


518 


529 


492 


3,755 


Average Score 


2.97 


2.88 


2.87 


3.40 


Standard Deviation 


.966 


.825 


.844 


1.15 
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The Vocobulary meon score for students in the Title I schools wos sig- 
nificontly higher thon the meon for students in the Model Cities ond Portiol Title I 
schools. This finding controsts with the obsence of sicinificant results for the "long 
term" students^ ond requires explonotion > 

Exominotion of the meons scores ond the stondord deviotions for the "long 
term" students ond for the whole populotion (which includes the "long term" students) 
demonstrotes thot the differences ore smoll. The reoson for the significont difference 
for the populotion arises from the foct thot larger numbers ore involved. Thot i$, o 
difference omong groups of 100 is not significont, while obout the some difference on 
groups of 500 is significont. 

But the issue must be foced of whot the procticol meoning of such find- 
ings moy be. It has been soid, statistics not lie, but liors use stotistics. The motter 
moy be summorized by noting that the maximum 'differences among these three categories ore 
smoll, on the order of two months. It is probobly not o chance difference, but the foct 
thot quite lorgenunbers of students hod to be considered reflects the existence of con- 
sideroble overtop in the distributions of scores of the school cotegoies. Each reoder will 
consider whether o difference of thot mognitude is sufficient to sotisfy his criterio of 
"procticoi" difference. The reoder will find help in thinking obout thot by continuing 
to review odditiono! onolyses presented below. 

The same analytic procedures were followed for Reoding Comprehension* 
There is o "suggestion" of differences, but even with these numbers of students, differ- 
ences among the three school cotegories were not significont. 

c . Results of Comparisons Among Four School Cotegories 

As indicated above, similor dato were olso obtoined for all third grade 
students in the remoining elemeniory schools in the District which hod not been included 
in the previous onolyses. The doto for these schools ore olso in Toble lll*7# These 
doto w^re compored with the doto for the other three cotegories of schools. For both 
Vocabulary ond Reoding Comprehension, the mean scores for students in "All Other" 
schools were significontly higher thon the meon scores for students in the other three 
cotegories of schools* 
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3, Results for the Populattans of Third Grade Students, 1966 and 1972 Data 
0. Data Retrieved 

An initial interest in the study had been to make comparisons between 
student outcomes in 1966 and 1972. After initial exploration, 1966 data were abandoned 
for the "loiig term" students. The primary consideration was the cost factor involved in 
retrieving such information. Another important consideration was changes in the popula- 
tion of families living in the areas served by the various schools. 

The interest continued to exist, and a decision was finally reached to 
retrieve minimal data for the 23 schools involved in the major analyses. Vocabulary 
ond Reading Comprehension data were obtained for the students in the third grade in 
those schools in 1966. 

b. Results of Comparisons Within Categories 

Two kinds of analyses were thus made possible. The first was the analyses 
described previously in which outcomes for students in the three categories of schools can 
be compored for a given year. The second is the comparison of 1966 outcomes for stu- 
dents within o category with the 1972 outcomes for the students in that category. The 
doto for 1966 ore presented !n Table 111-8 . Comporisons are mode using data from that 
toble ond Table \\h7. 

• 

Title I third grade students in 1972 hod a significantly higher mean score 
in Vocabulary than their predecessors In 1966. They hod essentially the some mean in 
Reoding Comprehension. 

There were no differences for Model Cities students. Students in 1972 
hod basically the some mean scores as did students in 1966. 

Third grade students in Partial Title I schools hod significantly lower mean 
scores for both Vocabulary and Reading Comprehension in 1972 than did third grade 
students in those schools in 1966. 

To put these findings together more clearly, it may help to bring bock 
Figure 1 from the Summary, that is, section 1 of this report. That figure portrays 
the suggestion in the data that students in Title I ore probably better off in 1972 
than students were in 1966. Model Cities students ore the sorr^e in both years. Partial Title I 
students seem to be faring less well. These results suggest that the Title I program, 
going longest and strongest in Title I schools^is having an impact. Much of that some 
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Table 111-8 



1966 JTBS Vocabulary and Reading Comprehension Data for all Third Grade StudenU 

in Three Categories of Schools 

Vocabulary 





Title 1 


Model 
Cities 


Partial 
Title 1 


Number of Students 


755 


857 


516 


Average Score 


2.81 


2.88 


2.92 


Standard Deviation 


.901 


.889 


.917 


Reading 




Title 1 


Model 
Cities 


Portial 
Title 1 


Number of Students 


757 


857 


516 


Average Score 


2.95 


2.94 


3.00 


Standard Deviation 


.971 


.969 


.996 
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progrcm, at work a shorter period of time in Model Cities schools, moy hove influenced 
those schools to *1iold their own. *' The obsence of such additional input for the Partial 
Title I schools may help explain the decrease in student means from 1966 to 1972. 

CAUTION: When one is looking at results from two points in time, he must 
Itoy owore that the results from either time (or both) may result from factors that are 
totally outside his attention. As an example, large numbers of students may be moving 
from schools in one area to another, thus chonging the type of student in a given area. 
During the 1960's man/ families moved from the Title I area into the Partial Title I area. 

On the other hood, large numbers of students ore being considered. The 
genero! similarity of the means across categories suggests that no major accidental 
condition produced the significant differences. 

4. Results for School Averoges for Third Grade Students, 1972 Data 

In section II of this report, it wos explained that staff were interested in 
foctors which might influence the outcomes so as to distort the impoct of the program. 
Much reseurch hos shown relationships between the socio-economic status of the parents 
or home of the student and student outcomes. It was not feosible in this project to obtoin 
doto on socio-economic status for individuol students. However, the Evaluation Coor- 
dinator for thA Division of Urbon Education recently performed on analysis of 1970 
federal census data regarding families cotegorized as below the poverty level. He com- 
puted the proportion of families below the poverty level for each school area, extrapo- 
lating from census tract data. 

The federal definition of poverty is bosed on the estimated cost of food for 
the family (dwelling unit). The food requirements upon which estimotes ore based ore 
very minimal but technically odequate for short periods of time, according to Deportment 
of Agriculture definitions. The family food cost estimate is also based on a variety of 
foctors, including homily size, sex of heod, oge of members, ond ploce of residence 
(form or non"*farm), * 

Thus, it wos possible to obtoin for each school on estimate of the percent of fomil- 
lies below the poverty leveL These were used as the indicotor of socio-economic status 
in this study. 
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Since these data were available by school, and not by individual student, it 
was necessary to have a school score on student outcomes to proceed with the onalysis. 
Mean scores were obtoined, as previously described, for all third grade students in a given 
school on Vocabulary and Reoding Comprehension, 

First, the straightforward analyses (that is, not considering socioeconomic 
data) were performed comparing the three categories of schools, using school averoges 
father than individual student scores. Again , no differences were found. 

It was intended that covariance procedures would be used to take socio* 
economic data into consideration. However, because relationships between the socio* 
economic data ond school average student outcome data were quite different firom cote* 
gory to category, such an analysis had to be dropped. 

U is worth noting, however, that the average percent of families below the 
poverty level by school category appears to be highest in Title I schools (25%) and 
lowest in Partial Title I (16%), with Model Cities schools in the middle (21%). Given 
frequent evidence that low socioeconomic status is associated with low ocodemic per- 
formance^ Title I schools seem to be performing better than would be predicted. That is, 
having the highest proportion of families below the poverty level, one would predict that 
they would have the most students performing poorly. Instead, the Title i schools are 
doing at least as well, and perhaps better than, the other categories of schools. 

The SES data were also available for the 54 other elementary schools in the District. 
In those schools, the average percent of families below the poverty level was 8%. One 
wonders if the performance of students in Title I, Model Cities, and Partial Title I schooU 
would match the performance of students in the 54 other schools if the socioeconomic 
foctors were olso motched. 

5. Results of Trend Studies 

a. Data for Title I Schools 

Data were obtained for third grade school averoges for Title I schools for the 
years 1966-1972 for both Vocabulary and Reoding Comprehension. These were charted 
by school and are shown in Figures 111*3 ond lll-'4. 
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Fig. IH-3. — Third grade average Vocobulary scores in 10 Tifle I schools 
and Sheir grond average, 1966-1972. 
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Fig. III-4. "Third grode overoge Reoding Comprehension scores in 10 
Title I schools ond their grond overoge, 1966-1972. 
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Given the variation in averages from year to year, it is difficult to discern a trend. 
The brood block line, which represents the overage for oil students in the 10 schools, does 
give o suggestion of on upward trend for Vocabulary. This would tend to support the dif- 
ference between 1966 and 1972 reported earlier. The chort for Reading Comprehension 
does not suggest any trend • 

b. Data for Model Cities Schools 

Unfortunately, data on school overages were not ovoiloble for the years 1967 
and 1968 for Model Cities schools. Given the variation of school means and of the 
average for oil students combined (shown by the broad block line), no trend con be seen 
for Vocabulary. Basically the same thing is true for Reading Comprehension (in Figure 
III-6). 

c. Doto for Partial Title I Schoo ls 

Again, data are not available for 1967 and 1968. While there is not o clear 
trend, the apparently lower scores In 1970 through 1972 on Vocabulary do m(3tch the 
differences between 1966 and 1972 discussed above. For Reading Comprehension, the 
average ocr^ss schools for 1971 and 1972 appears lower than 1966, also supporting the 
earlier onoiysts. B*jt one would be treading on soft ground to call these real trends. 

d. To sumntarize rhe trend charts, if is difficult to see clear trends., Optimistically, 
one could hope that they suggest that students in Title I ore at least holding their own, 
perhaps improving, ir, cornparison with Partial Title I students. But the data ore very 

hazy ond ccitQiriiy not statisticcuiy supper; ed, 

6. Svfnrr.ory of Pate for Third Grode Stude nts 

Ihe boilc finding must still be that no differences among the three categories 
were four<d when "lor>g term'* students, those rjn v/hom the program was most likely to 
hove moior effects, were compored. However, there ore a number of encouraging signs. 
Based on analyses of scores on all students in the three categories of schools, Title I 
students score higher on Vocabulary, but not on Reading Comprehension. Title I stu- 
dents in 1972 icorc higher on Vocabulary than did such students in 1966. Model Cities 
students score essential*/ the some in 1972 os did third grade students in those schools in 
1966. In 1972, students in Partial Title I schools hod lower mean scores in both Vocabulary 
ard Recadincj Coniprohcnsion than did studen^s in thosfi schools in 1966. There ore hints 
thot l ilic i . Jef:i.^ . ;vu« fojr.Mn9 better thr:^n socioeconomic data would predict. 
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Fig. III-5. — Third grade average Vocabulary scores in 8 Model Cities 
schools and their grand overage, 1966- 1972. School averages not availoble for 
1967 and 1968. 
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Fig. 1 11-6. --Third grade average Reading Comprehension scores in 8 
Model Cities schools and their grand average, 1966-1972. School averages 
not available for 1967 and 1968. 
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Fig. III-7. — Third grade average Vocabulary scores in 5 Partial Title I 
schools and their grand average, 1966-1972. School averages not available 
for 1967 and 1968. 
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C • Summary of Analysis of Student Outcomes 

It often seems that researcli on educational programs especially evaluative 
research "~ leaves one feeling that the outcome is not as clearcut and informative as one 
would wish. This Is particularly the case when program development and research have 
not been able to go hand in hand from the beginning. In the present case, the leadership 
of the Division of Urban Education had the wisdom to initiate measurement of student cogni- 
tive outcomes from the beginning of the program* Unfortunately, similar measurement was 
not financed in the remainder of the District. Thus, pre-post measurement with comparison 
groups over time was not available as a basis for study design. 

As a consequence, major reliance was placed on analysis of outcomes for long 
term students, those who had been in a given category of school, for 70% or more of 
their school lives. That is, a post measurement comparison across students in Title I, 
Model Cities, and Partial Title I schools. Analyses were performed on sixth and third 
grade students. 

The results of these analyses for long-term sixth grade students was that no dif- 
ferences appeared among the three categories of schools on the ITBS measures. Trends 
did not appear to be clear and consistent for sixth grade students. 

The analysis of outcomes for long term third grade students similar!/ found no 
differences among school categories. However, when using oM students in those schools 
for the analysis. Title I students scored significantly higher on Vocabulary than did stu- 
dents in Model Cities and Partial Title I schools. Since average scores and variances 
fro.Ti the two analyses are very similar, it seems that the larger numbers in the second 
analysis make inter-category differences significant. This situation suggests that real 
(rather than chance) differences exist, but that they are relatively small. 

Additional analyses for all third grade students, comparing scores of students in 
1966 with scores of students in 1972 within a given school category, showed Title I students 
to be significantly higher in 1972 on Vocabulary but not Reading than were Title I students 
in 1966. Model Cities students showed no differences. Students In Partial Title I schools 
in 1972 were significantly lower than students in 1966 on both Vocabulary and Reading 
Comprehension. 

The visual examination of trend charts for third grade students produced no clear 
perception of a trend for either Vocabulary or Reading Comprehension. 
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IV^ ANALYSIS OF SCHOOL DISTRICT STAFF PERCEPTIONS AND ATTITUDES 

School system personnel who were working in, or witli, each of three categories 
of schools, Title I, Model Cities, and Partial Title I, were asked to indicate their views 
in a questronnaire concerning the compensatory program with which they were associated. 
Questionnaire items asked for views concerning such things as program impact upon stu- 
dent achievement, upon human and material resources, upon amount and quality of in- 
service training provided school staff, and upon parents and the community. Other 
questionnaire items elicited staff views concerning implementation of compensatory 
programs, their attitudes toward such educationol programs^ and suggestions and recom'" 
mendations for changes or modifications. 

The questionnaires were distributed near the end of April, 1973o After collecting 
and checking, it was found that useable questionnaires were available from 71 Title I 
teachers; 48 Model Cities teachers; 40 Partial Title I teachers; 13 principals; 24 reading 
specialists in the schooU; and 10 consultants, coordinators, specialists and administrators 
in the central office. These respondents are located in all the schools involved as well 
as the central office, and are expected to be representative. They comprise about 40 per- 
cent of all the teachers, administrators, consultants, coordinators, and specialists in~ 
volved in the programs. 

There was some interest in whether short-term teachers, those with limited ex- 
perience in a given school, would respond differently than teachers with longer service* 
It was possible to check this with Title I teachers, since 21 had one to three years* service 
in the program, while 50 had four or more. However, it was found that views of short 
and long-term Title I teachers usually were not significantly different. Therefore, 
responses of those two groups will be reported separately only when there were signifi- 
cant differences. 

The information on staff perceptions and attitudes is organized for reporting 
purposes under the following headings: 

A. Impact of the Programs 

B. Factors Affecting Program Outcomes 

C. Factors Affecting Program Implementation 

D. Suggested Changes 

E. Summary of Questionnaire Data 
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A. Perceptions of the Impact of the Programs 

Questions were asked about the amount of improvement brought about for students, 
staff, relations of parents and community to the schools, human resources, material resources, 
ond facilities. 

1. On Students 

a. Reading Achievement 

This wos the most frequent student achievement identified by teachers in each 
of the three categories of schools as showing improvement to a very great or considerable 
extent as o consequence of compensatory programs. These results are presented in 
Table IV-I. In Title I (Tl) and Model Cities (MC) schools, the mojority of teachers 
expressed this view. In Partial Title I (PTI), slightly less than half (45%) of teacf)ers 
indicated this extent of improvement in reading. Teachers in PTI schools, were more 
likely to see little or no improvement (one in five) in reading in contrast to Tl (1 in 12) 
and MC (1 in 20) teachers. 

Principals, reading specialists and Central Office staff were in agreement 
with teacl.ers that reading skills of children had been improved to a very great or con- 
siderable extent by Tl or MC programs. Reading specialists were most emphatic with 
87 percent expressing this view. In none of these administrative and specialist sub- 
groups was the view expressed that there had been only minimal or no improvement. 

Some respondents wrote in comments regarding outcomes for students. Severe! 
commented on advantages they saw in the use of the Sullivan program. However, one 
stated, "I have not witnessed any significant improvement academically for those eligible 
students under the Title I program." 

b. Other Stu de nt Outcomes 

The quesjfonnaire osked School DistricJ personnel to identify other outcomes 
ai^d listed six additional areas where improvement might have occurred: arithmetic, 
science, thinking, titudy skills, self esteem, and working with others. 

There were differences in fhc orcas ond in the extent of improvements per- 
ceived by School District personnel in Tl, MC and PTI, but the majority of each group 
indicated thot ^hey perceived ot Icasf some improvement in all cases but one. 
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A$ shown in Tobic IV*-!, Tl tcochcrs were rrore likely than PTI feochers to 
indicate that improvements to a ver)' great or considcrobic extent hod been mode in 
orithmetic skills* Among PTI teachers^ 50 percent cxpicsscd the opposite view indi- 
cating they felt there hod been tittle or no improvement in this student outcome. This 
IS the only skill area In which o majority of a subgroup did'not repoft ot leas? some Of 
more improvement. The percentage of respondents indicating some improvement is not 
shown in the table but can be derived by adding the two percents given and subtracting 
from 100 percent. 



Other differences' among teachers In the three categories of schools were 



these: 



MC teochers were more likely thon teochen^ In Tl end PTI schools to report 
improvement to a very great or considerable extent fi\ thinking and working with others. 

MC teochers were more likely thon Tl tcGchers to say that improvement in 
science hod occurred to a very little extent or not at all. 

MC teachers were more likely ihon PTI teachers to report improvement to a 
very g^e^* . t considcrcble extent In study skllls'and self esteem. 

lurning to responses of reading spccioliits and central office staff, it appears 
that these groups are often more likely to report very great or considerable improvement 
and less likely to report iiJtle or no improvement than teachers. Closer examination 
indicotes that reading specioJists am probably not significantly different from MC 
teochers on cs^^'/ areas ond different from Htle I teachers onfy on ihinkfng, where they 
ore more- likely to iQpor\ lortjo Improvement. Reodlng specialists also are more likely 
to report icjgc cfiC'wjt than t'^TI teocficrs on reading, arithmetic, thinking, self esteem^ 
and working .vlrh others. 

The responses of principals were not significontly different from those of 

teachers* 



A 

'when stotcmrnts ore mode that a difference exists^ a check has been mode 
such that it i< unil'<ely that chonce lias, caused tliot difference. When statements arc 
n ode obriut cppofcnt ({i fffrcncos^ It may be that chance has caused the difference. 
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2* On Staff and Community Member s 

Among the goals of the compensatory programs are increasing the skills and 
knowledge of teachers and developing better relationships with parents and others In the 
school community. Respondents were asked a series of questions which explored the extent 
of improvement brought about by the Title I and Model Cities programs for those people. 
These data are reported in Table IV-2. 

The data in the table suggest that there was general agreement among School 
District staff that improvement was greater in regard to outcomes for teachers than for 
other groups. A majority of all respondent groups except PTI teachers reported improve- 
ment to a very great or considerable extent in teacher instructional skills. Given the 
limited time which they have participated in the program, PTI teachers might be ex- 
pected to be different on this matter. 

Generally speaking, reading specialists and central office staff appear to have 
been more likely than Tl and PTI teachers to report improvement in teacher skills and 
faculty relationships. Among teachers, MC teachers were more likely than other teachers 
to soy that there had beetn improvement to a very great or considerable extent in faculty 
relationships. 

With regard to improvements in parent and community interest, supoort and par- 
ticipation, only a minority of teachers in each subgroup indicated that they saw any 
marked improvement. PTI teachers were less likely than other teachers to indica^e 
improvement of this kind for parents and the community. 

Generally, reading specialists and central office staff appear more likely than 
teachers to report improvement to a very great or considerable extent in oil of the areas 
listed. Principals, on the other hand, tend to give responses similar to those given by 
teachers. 

3. On Human and Material Resources 

District staff menibers were asked a series of questions about the amount of 
improvement which Title I or Model Cities assistance had made in a variety of human 
and material resources and in facilities. The responses given are presented in Table 
IV-3. 

Looking across respondent groups and areas of possible improvement (that is, 
the whole table)^ at least 20 percent of every group saw improvement to a very great 
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or considerable extent on every area. When all respondent groups ore combined (an 
onalysis not shown in the table), at least one-third of oil respondents reported that level 
improvement in every area. It appears that more respondents saw large improvement in 
the cvailability of specialists, availability of assistants, and material for pupil use than 
saw large improvement in other areas. 

Tl teachers were more likely than MC or PTI teachers to say th^it a very great or 
considerable improvement hod taken place In the availability of assistants, such as in- 
structional secretaries and aides. PTI teachers were less likely than other teachers to 
report that o very great or considerable improvement had been brought obout in the 
availability of specialists; in books, workbooks, or other "material resources"; or 
multimedia (audiovisual, TV, listening centers). 

Reoding specialists, principals, and the central office staff generally seemed 
more likely than teachers to report improvement In those resources to a very great or 
considerable extent. 

Not shown in the table but developed in another analysis, there is one signifi- 
cant diffe'^'nce between the views of Tl teachers with one to three years experience in 
Title I schools and views of Tl teachers with longer service. Forty-five percent of the 
short term teachers reported improvement to a very great or considerable extent in 
materials for pupil use (books, workbooks, etc.) as compared with 72 percent of the 
long-term teachers. 

Several rv^spondents wrote in comments on the questionnaire which have pertinence 
here. Of those commenting, most reported tha^ more human and material resources were 
needed. Among the comments were these: "Some Title I schools have teacher aides. 
We do not. I truly believe this has been a very bad thing because our children will 
suffer and the grade levels will fall ..." "Reading teachers are spread too thin . . 
"There are too many consultants, supervisors, and superintendents, just rignning over one 
another doing nothing ..." "... services of support persons are needed in all grades, 
not just primary. " 

Comments on materials were mixed. Some reported improvement: '^The children 
in the poor neighborhoods have been given an opportunity to work with equipment, 
materials, specialists, and in surroundings not available in other circumstances." Some 
described inadequacy: "Most teachers feel that supplies to Title I schools are limited, 
moresothan ManaQcmcnt sch.ools. We ore sup posed to get many things, but get nothing. " 
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4 . Summary of Views c Inipacfs of the Programs 

Summorizing tlie views of School District stoff regarding the outcomes of the 
Title I ond Modtl Cities programs, they report greatest improvement for students in read- 
ing. The second area of improvement most frequently indicuted v/os in teacher instruc- 
tional skills, understanding of children, ond sense of competence. Although improve** 
ment in other areas for students was indicated, there wos quite a lot of variobility omong 
respondent groups regording the extent of improvement in different skills. Respondents 
generally perceived less improvement for pcrents or community interest, support, or ;'>ar- 
ticipatlon. 

While most respondents sow lorge improvement in the availability of human end 
material resources, some did not. In general, respondents saw least improvement in 
instructional facilities. 

Perceptions of Foctors Directly Affecting Student Outcomes 

Student outcomes from porticipotion in o progrom depend upon a variety of 
factors. The octivities of the program, the activities ond opprooch of instructional 
personnel, the odequocy of the materiols and facilities, ond chorocteristics of the 
students are among those factors. Questions were osked of the School District personnel 
regarding some of these matters ond will be reported here. The three oreas to be covered 
include information on classroom oides, on expectotions held for students, and on in* 
formation on student progress. 

Among the factors thot might be expected to significantly influence the teacher's 
carrying out the Tl or MC progroms ot the clossroom level is the use of clossroom aides* 
In both programs, the classroom aide is considered to be one of the most important pro* 
gram factors focilitoting the classroom teacher's implementotion of intended program 
activities* 

In the questionnoire, school personnel were first osked whether they hod o.i aide 
currently or hod hod on aide in previous years. Those responding yes were requested to 
identify from a list of eight octivities those that aides were supposed to do* Space was 
provided for the writing 'n of odditionol octivities ond comments. Following this, they 
were asked to indicate the extent to which their aide did whot he or she was supposed to 
do. Table IV-4 summarizes school personnel responses. ^ 
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Table IV-4 

Teacher Perceptions of Classroom Aides in Title I and Model Gties Programs 



Questionnaire Items 
Pertaining to Aides 



Title I 
N=71 



Teachers 

Model 
Cities 
N-48 



Partial 
Title I 
N=40 



0/ 

% 


% 


% 


18 


27 


59 


82 


73 


41 


73 


81 


61 


58 


61 


78 


92 


83 


78 


31 


56 


33 


85 


83 


67 


71 


75 


67 


18 


25 


11 


82 


78 


67 


66 


53 


44 


63 


78 


83 


14 


11 


11 



Do you or did you have an aide? 

No 
Yes 



what activities^ are or were 
fo be done by the aide? 

Monitor pupils 
Tutor pupils 
Reinforce instruction 
Read aloud to pupils 
Set up ''.jdio^visuol 
Make instructional material available 
Distribute materials from room to room 
Attend to daily routine 
Do general housekeeping 
Check test papers 
Other activities 



To v/hat extent does or did your aide do 
what was intended? 



To a very great extent 
To a very considerable 
To some extent 
To o very little extent 





66 


31 


33 


extent 


22 


26 


33 




8 


29 


27 




3 


14 


7 



'Percent computed on basis of numbers of teachers responding to the item. 
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As indicated in Table IV-4, most teachers in Tl and MC schools said that they 
currently had or had had a school aide in their classroom, PTI teachers vrere less likely 
to indicate this, although 41 percent of them did. 

Across school cotegories teachers appear to most frequently indicate reinforce- 
ment of instruction, setting up audio^visual equipment, attending to daily routine, and 
making instructional materials available as the kinds of things aides were supposed to do. 
Approximately two^thirds or more of the teachers in each school category agreed thai' these 
were intended activities of aides, 

A majority of teachers also indicated that aides should be responsible for monitor- 
ing pupils, tutoring pupils, and checking test papers, PTI teachers somewhat more 
frequently than Tl and MC teachers indicated tutoring pupils to be an intended activity 
of classroom aides. 

There were few significant differences between how teachers in the three dif" 
ferent Categories of schools perceived the intended classroom role of aides. Model 
Cities teachers were somewhat more likely than Tl or PTI teachers to think aides should 
read cloud to students. Tl teachers were somewhat more likely to see general house*" 
keeping as a legitimate area of activities for aides than were PTI teachers. 

Relatively few teachers indicated that aides were responsible for distributing 
materials from classroom to classroom • 

In substance, teachers generally identified the intended role of' lassroom aides 
in terms of activities that would reinforce teacher instruction, assist in helping individual 
children having difficulty and to attend to those daily classroom ^res and functions that 
free teachers for teaching. 

As shown in Tab!e IV-4, most teachers who expressed their views concerning 
whot aides were supposed to do indicated that their aides had, to a very great or con" 
siderable extent, actually done these kinds of things, 

T! teachers were most favorably impressed with the performance of their aides 
with about two*"thirds of these teachers indicating that their aides had to a veiy great 
extent done what they were supposed to do. 

Many respondents wrote in comments regarding aides. Their views varied 
dramatically, '*Aides were the best help to come out of Title I , • "Aides I have 
had either wanted to be on a continuous coffee break or have the role of the teacher , . » 
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Often did |ob$ wrong so they w,ouldn*t hove to do them again • • . Sev'eral respondents 
reported that training for aides was not adequate. ''Aides were put in the building with 
no preparation or explanation • . . " 

A Summary statement might be that when the aide and teacher agreed on tasks end 
roles and carried them out, the results were viewed as beneficial to the program. When 
this was not the case, aides wore not seen as helpful. 

Another factor that was considered likely to have direct impact on classroonri 
octivity ond level of instruct ion is expectations of students held by school personnel. 
This factor has been discussed frequently in the educational literature and is considered 
to be one well worth assessing. The argument in the educational literature is that low 
expectations of teachers may be related to low outcomes for studentSo This position is 
not proven, but some evidence does support it. 

In the questionnaire, school personnel were asked, "How much do most school 
staff expect of students in the /Title I or Model Cities/ p'rogram?" The percentage 
distribution of responses by teachers and other District staff are shown in Table IV-5. 

The majority of respondents indicated that District staff did not exf ^'t too much 
or too little from Tl or MC students. In each subgroup of respondents, hoAvJver, there 
appeared to be more who felt the staff expects too little from students than there were 
those who felt the staff expected too much. 

Among teachers, better than one in four Tl and PTI teachers indicated that the 
staff expected too little of students. 

One question asked whether the Sullivan program provides a better picture of 
the child's daily reading progress than the Scott Fore:man or oth^r basal reading programs. 
Toble iV-6 provides the responses given. 

It appears that respondents ore more likely to answer yes to the question. Among 
teachers, 75 percent of Partial Title I teachers have not had experience with both pro- 
grams. Since Sullivan has not boen introduced into those schools (except for one or two 
classes in one school), most teachers cannot make comparisons. Teachers who have had 
experience with both programs tend to favor the Sullivan-EDL programs, almost three 
teachers saying yes for each one saying no. 

Reading specialists ovorwhoimingly favor Sullivan^EDL, as do principals and 
central office staff. 
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A number of respondent's wrofe in comments. Some noted that the Sullivan 
program irequtres detailed records, which one said required the help of an aide* 

Other respondents used the opportunity to comment on the programs themselves* 
Several wrote that the Sullivan program was better for slow readers but less good for fast 
readers* Several said things like, *'! feel it depends on the child as to which program is 
best*" 



74 



C. Factors Affecting Program ImplGmcntotion ond Operotion 



Educotlonol progroms do not leap into being with the arrival of new texts or 
the completion of a teacher workshop in August. The octivifies and conditions in the 
classroom which greotly influence the learning opportunities availoble to students are 
integroted into the moterials, focilities, school district policies ond regulotions, teacher 
knowledge and expectotions, faculty relationships^ ond community relations — to nome"^ 
t Q few. To change the octivities of the clossroom in morked woys, which would seem to 

be required in order to bring obout marked chonges in student outcomes, requires the 
changing of oil those foctors (ond others) in greoter or lesser woys. 

To provide the educotionol staffs involved in the Title I ond Model Cities pro* 
grams with informotion obout some of those foctors, o series of questions were osked 
about those which moy hove been affecting the implementotion of the Title I and Model 
Cities progroms ond therefore affecting the student outcomes of those progroms. 

These questions deol with the following oreos: 

Teacher role, the activities which may be different. 
Approprioteness of in-service training. 
Influence on the day"to'*day operation of the program. 
Agreenient omong school faculties on progrom purposeSo 
Understonding of and ottention to teacher instructional problems. 
Attitudes toword compensatory education. 

1 • School District Stoff's Perceptions of Tl ond MC Teocher Role 

Implementotion of new programs tokes time. This is especially true when the new 
progrom requires teochers to work with children in different woys or when the program in'* 
volves brihging odditionol odulvs into the clossroom to shore in the octivities with the 
students. Therefore, on importont foctor in getting o progrom implemented so that it 
can moke o difference in student outcomes is the omount of chonge thot a program 
requires of teochers. 

To provide some informotion on this motter, oil respondents were osked whether 
the Title I or Model Cities programs required that teachers do different things or to do 
things differently from teochers in other progroms. The onswers given con point to 
possible problems in getting a program operoting in the woy it was intended to operote. 
They can olso suggest wlicther it is oppropriote to expect mojor impact on students in the 
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short period of o year or two or perhaps even more. These dota also suggest whether 
people in the School Disfrict sec the role of teachers in these progromj os different from 
thot role Jn other programs. 

The question wos first posed os to whether there were differences* Those fe* 
spordents who stated thot there ore differences were then osked which of eight octivities 
they believed there were differences in. These eight activities were determined in dis* 
cussions with leaders of the Title I and Model Cities programs who carried administrative 
ond/or training functions in the prcgroms . Spoce was also provided in the questionnaire 
for respondents to write in other octivities which they saw os different^ 

Table IV-7 summarizes the percentoge distributions of the responses given by 
reading specialists, principals, ond central office stoff. 

Across the three categories of schools, obout one-fourth to one-fifth of re- 
spondents indicoted thot they hod hod no other experience and so could not makd 
comporisons. Of those moking the comporison, over holf of the teachers in each of 
the three school cotegories indicated that they were required to do different things or 
do things JIfferently than teochers in other school progroms. MC teachers indicated this 
somewhot more frequently than PTI teachers. Only one in nine MC teachers in contrast 
to about one in four PTI and one in six Tl teachers indicated no difference in activities 
required of them- 

It appeors thot reading specialists, principols, ond particulorly central office 
s^aff indicated more frequently than did teachers that the activities xjf-TI and MC teachers 
were different. 

For teochers who perceived their activities os different, there were some apporent 
similorities and differences across the three categories of schools in terms of specific 
octivities most frequently identified as different. 

|he majority of Tl, MC ond PTI teachers indicoted that the in-service training 
participation of teachers was different for them than for other teochers« For PTI teachers 
this was^the one ond only octivity listed in which the majority agreed that this repre- 
sented a different requirement for them. In only two other activities, use of instructional 
materials ond diognoses and prescribing, did os many as opproximotely one in three PTI 
teochers ogree thot these were different. In oil the remaining activities, only one in 
four or fewer PTI teachers indicalcd \hat they saw a difference. 
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In oddUSon fo inservice troining requirements, the mojorlty o? Tl and MC 
teochers indicated that they considered continuous student progress evaluation and use 
of instructional moteriols as different from requirements of teochers in other programs. 

For Tl teochers these were the outstonding differences indicated although they 
did indicote somewhot more frequently thon both MC and PTI teochers that handling 
professionol o^d lay visitors in ihe clossroom wos o different ocMvity for them* 

MC teachers identified severol other octivities that differentioted their role from 
Tl/ PTI and other teochers. MC teochers more frequently indicated thot planning and 
writing objectives, using audio-visuol equipment, diognosing ond prescribing for learn- 
ing problems were different requirements for them than for other teachers. 

Across the three categories of schools, porticulorly MC ond PTI, most teochers 
did not indicote thot receiving continuous supervision v/os much different for them than 
for teachers in other programs. 

• 

With regord to perceptions of other school district personnel, most reodifig 
specialists, principols, ond porticulorly centrol office staff indicated that the activities 
of teacher In Title I ond Model Cities programs differed from those of teachers in other 
programs. It oppeors thot these groups were more likely to report differences in the 
teacher's role than were the teochers. One oreo of the teocher role in which there are 
clear differences between teochers' perceptions ond the perceptions of other District per- 
sonnel is that regording teochers receiving continuous supervision. Contrary to what 
some might expect, other District personnel (reading specialists, principals and central 
office staff) are more likely thon teochers to report this os different for teachers in these 
progroms. 

Some respondents wrote in comments on the question obout differences in teacher 
activities. Many of these point to difficulties. "Much extra and unnecessary paper 
work ..." "Teochers must reorronge closs schedule to fit speciolist's schedule. Teachers 
cannot hove classe:* while eligible pupils are with specialists." Another commented, 
"More in-service training, which is o good motivoting factor for oil teochers ond persons 
involved , ' 

Another item-, not presented in the toble, osked respondents to indicate whether 
the Sullivon or EDL reoding progroms required more teocher effort than basol programs. 
About 23 percent of the totol group of respondents onswered thot they hod not worked 
with both kinds of progroms. Of the remainder, about 75 percent said the programs re* 
quire more or much more effort. 
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2. Appropriotenfiss of In-service Training 

As indicated above, mast Tl and MC teachers saw their participation in in"' 
service training as a requirement differentiating them from other teachers. In discussions 
of the compensatory programs, School District staff have stated that such training was a 
very Important component. In that context, a question was asked as to how appropriate 
rtie kind of training provided was for what was required in carrying out the progrom. 
The answers given ore presented in Table IV-8. 

It appears that teachers ore less likely than other respondents to see the training 
as highly oppropriote and may be more likely to describe it as inappropriate or very in- 
appropriate. While the small numbers of respondents in other groups moke comparisons 
somewhat uncertain, these data do suggest \\\o\ specialists, both those in the schools and 
those in the central office^ may be either overestimating the appropriateness of the 
training or not developing teacher understanding of fits appropriateness. However, as 
Table IV"8 shows, nore teachers in each category of schools sow the in-service training 
OS at least somewhat appropriate than saw it as completely inappropriate. 

Several respondents added comments of their own regarding the training activities. 
More of the comments were negative than positive. "Our in-service training never seemed 
to pertain to my class. The sessions were always so rushed.*' "I don't know anything about 
the training." "On the other hand, a few said things like, "Excellent." A suggestion for 
change was, "Should hove been /done/ jointly with paroprofessionols and . • . ^iven/ 
all basics and time for making appropriate teaching aids before entering classroom.** 

3 . Influence on the Day-ta"day Operation of the Program 

In considering the implementation of a program, and particularly when interested 
in change, it is useful to learn what people who ore involved in the activities of the pro*^ 
gram see as influencing the day-to-day operation of the program. Respondents were asked 
to rote the amount of influence which on array of individuals^ groups, and regulations had 
on the day-to"day operation of the Title I and Model Cities programs. The percents re- 
porting o very greot deal or great deal ore presented in Table IV-9. 

At least 50 percent of the respondents in each group attributed o very greot deal 
or o great deal of influence to: 

Federal guidelines 
Reading supervisor 
Reading consultants 
Reading teocher 
Classroom teacher 
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Five of the six respondent groups attributed that amount of influence to urban 
education evaluation. Four groups rated the day-to-day mfluer>,ce of the principals that 
highly, and three did the Assistant Superintendent for Urban Education, 

Parents and community organizations seem to be seen as having less influence 
than other groups. Teachers and principals, who would be expected to have most con- 
fact with parents, agreed in attributi.)g least influence to them and community organi- 
zations. 

4# Agreement Among School Faculties on Progrom Purposes 

Respondents were asked whether there was agreement among most of the staff in 
their school about what the Title I or Model Cities program was supposed to accompSish., 
The percent in each respondent group v/ho reported that there was agreement to a very 
great or considerable extent is shown here: 

47% of Title I »*eacher5 

49% of Model Cities teachers 

25% of Partial Title I teachers 

61% of Reading Specialists 

77% of Principals 

89% of Central Office staff 

Approximately half or more of all respondent groups except PTI teachers reported 
high levels of agreement on program purposes. It appears that teachers were less likely 
than other groups to report high agreement. In addition, at the other end of the 
agreement scale, eight percent of Tl teachers and 15 percent of both MC and PTI 
teachers reported the extent of agreement as very little or not at all« PTI teachers 
were less likely than other teachers to report high levels of agreement. 

Ten percent or more of the teachers In each category of school reported that 
there had been no discussion of the program. None of the respondents in other groups 
selected that response , 

Thus, just under half of all respondents report high agreement on progrom purposes 
However, about 24 percent of all teachers report low agreement or that the program has 
not been discussed. This suggests that those teachers, the persons whose actions have the 
most direct impact on student outcomes in their classes, were not clear that program pur- 
poses ore agreed on by school staffs. V/hether such a situation is influencing program 
implementation ond effectiveness might be v^orth exploration. 
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5 . Understanding of on d Afrtenfrion fro Teacher Insfrructionol Problems 

In implementing Title ! or Mode! Cities programs in :^pecific school settings, the 
support and understanding of principols concerning teachers problems in carrying out the 
programs were considered to be important factors influencing implementation. 

In the questionnaire, Items requested School District staff to express their views 
concerning: 

The extent to which school principals understood problems confronting 
teachers in implementing program activities. 

The extent fo vh ich these problems were attended to. 

With regard to teachers' perceptions of the principaTs understanding of their 
problems, approximately half of Tl and PTI teachers and nearly tv/o-thirds of MC teachers 
indicated that they felt their principals understood to a very great or considerable extent 
the problems confronting them in carrying out the programs. The data are in Table IV" 10. 

In each school category, 14 to 20 percent of the teachers expressed the view that 
there was very little or no understanding of their problems by their principal. 

Considering the responses of other respondent subgroups, about ^//o'thirds cf the 
reading specialists indicate that principals understood teac;hers problems to a very great 
or considerable extent, and none in this subgroup saw principals as havinr very little or 
no understanding. Principals responding to the questionnaire were unanimous in their 
views that they understood teacher's problems to a very great or considerable extent. 
Of the central office staff, 20 percent thougfit that principals understood to a considerable 
extent, and 80 percent thought they did to some extent. 

Another item, not in the table, asked the extent to which members of the reading 
staff who are not based i'i the schools understand the problems teachers have in carrying 
out the programs. Many such persons are in the central office staff group of respondents. 
The major differences from the data regarding principals' understanding is in the responses 
of principals and central office staff. All the principals who responded reported that 
principals have great or considerable understanding, but only 46 percent of them 
thought the reading staff not based in the schools had that level of understanding. 
Whereos 20 percent of the central office staff thought principals had great or consider- 
able understanding, 100 percent thought reading stoff not based in the schools hod this 
level of understanding. It would seem that these groups have quite disparate views of 
each other on this matter. 
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Turning attention to the extent to which those problems have been attended to, 
it appears in Table IV^IO that about one-third to one-half of the teachers think they 
have been attended to to a great or considerable extent. Thus, more teachers appear 
to think there is understonding of their problems than think the problems are being 
attended to. At the other end of \he scale, from 17 to 24 percent of the teachers in 
each school category think the problems have been taken care of to a very little extent 
or not at alL 

Readtng specialists, principals and central office staff expressed a somewhat more 
favorable view. Central office staff and reading specialists were most positive in this 
view (78 to 70% respectively) with principals somewhat less frequently yet still a majority 
(60%) indicating this. 

6. Attitudes T o ward Compensatory Education 

Often the most dynamic factors Influencing implementation of educational 
program* are the attitudes and feelings tow'ard the programs held by those people directly 
involved in its day to day implementation. To elicit attitudes about the programs, the 
questionnaire contained several items rec"est;>-:^ 'i^spondents to indicate how they per~ 
ceived other school staff felt abou> '^^.e piogro^Tr^ to estimate the relative proportion of 
teachers leaving beccuse i'h-oy aid not like either the Tl or MC programs, und to indicate 
their opinion cdcer-I the effects on students of discontinuing such compensatory pro- 
grams. Teachers were also asked to express their current views on the organization and 
structure of the Title I program as it is operating now. This latter area was explored 
only for Title I and PTI school school personnel because it was not applicable to MC schools. 

Table IV- 11 summarizes respondent perceptions of what most teachers thought 
about Tl and MC programs, their estimates of teachers' leaving because they did not likq 
the programs, and their opinions concerning the consequences to students of discontinuing 
these compensatory efforts. 

As seen in Table IV-ll, the majority of the teachers in each of the three cote" 
giries of schools expressed the opinion that teachers with some experience in the programs 
were favorable toward them. Tl and MC teachers more frequently than PTI teachers 
expressed this view. 

It appears that more reading specialists and central office staff than teachers 
expressed the view that most teachers were favorable toward Tl and MC programs. 
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The perception of favorable attitudes toward the programs receives some support 
in the question concerning the proportion of teachers who hod left who left because they 
did not like the program. Relatively few thought as many as 40 percent of the teachers 
leaving left for that reason. 

Among teachers, Tl teachers are more likely than MC or PTI to estimate that 
fewer than 40 percent left for that reason. Perhaps because the programs had been in 
operation a shorter period of time, more MC and PTI teachers did not answer the question 
or said they did not know; nearly two-thirds of the teachers in those schools so answering. 

Specialists, principals, and central office staff appear more likely than MC and 
PTI teachers'to report fewer than 40 percent of teachers leaving left because they dis- 
liked the programs. 

The generally favorable view of Tl and MC programs held by School District 
personnel, is fairly clearly expressed in their responses to the question concerning the 
consequences to students of discontinuing these educational efforts. In each school 
category the majority of teachers indicated that students now involved would be hurt by 
discontinuance. Eight to 10 Tl teachers expressed this view, better than 6 in 10 MC 
teachers also saw such consequences of discontinuance and slightly better than 1 in 2 
PTI teachers were of this opinion. The most significant difference in responses was be- 
tween Tl and PTI teachers with this latter group having about 4 in 10 teachers who felt 
students now participating would not be affected much in contrast to slightly more than 
1 in 10 Tl teachers who indicated this. 

Reading specialists, principals and central office staff were in agreement with 
the majority view of teachers that students now participating would suffer if Tl and MC 
programs were discontinued* Reading specialists and central office staff were most 
emphatic in this view with all but one reading specialist and all central office staff 
personnel indicating negative consequences to students if the programs were tennr^inated. 

With regard to attitudes concerning recent changes from school to individual 
criteria for eligibility, School District personnel were asked whether the current policy 
of gearing services to individual student needs was better for children than gearing 
services to school criteria. 
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The majority of Tl and PTI teachers responding indicated that they felt that 
gearing services to individual student criteria was either not as good or was much poorer* 

80% of Title I teachers 

56% of Partiol Title I teachers 

Partial Title I teachers had had experience mainly with services directed to 
individual students during the year or two that some aspects of the Tl program had been 
in operation in their schools, so their information on school criteria for services was 
presumably limited* Most Tl teachers had experienced the school criteria arrangement 
over a several year period, and only within the last year had experienced the services 
for Individual arrangements. 

Within Tl end particularly within PTI schools there were a number of teachers 
who felt the services for individuol arrangement was either better for children or 
about the same as school criteria arranagement* 

20% Title I teachers 

44% Partial Title I teachers 

Th<> Tl and PTI principals and reading specialists who responded were emphatic 
in their views concerning ''individual" criteria as being either not as good or much poorer 
than school criteria: 

100% of Principals 
81% of Reading Specialisfs 

Written comments by respondents suggest this matter is of greater concern than 
any other dealt with by the questionnaire^ Most comments strongly support the evidence 
provided in the paragraphs above. 
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7. Summary 



Reviewing the factors which may affect ttie irnplementatian and opcratian of 
the Title I and Madel Cities programs, the following statements con be made; 

Many respondents stote that teachers are required to do different things, 
especially regarding in-service training, continuous evaluation of 
student progress, ond use of instructionol moteriols. 

Most respondents describe the in-service troining os ot least somewhat 

oppropriote; teochers moy hove been somewhot less fovoroble thon other 
respondents. 

High influence on the doy-to-doy operotion of the progrom wos ottributed 
to federol guidelines, the reoding supervisor, the reoding consultonts, 
reoding teochers, ond clossroom teochers. 

About half of the Tl ond MC teochers reported very greot or consideroble 
ogreement omong school stoff on whot the progroms were supposed 
to occomplish; sixty percent or more of the reoding speciolists, princi- 
pols, ond centrol office stoff soid the some. Only 24 percent of the PTI 
teochers thought so. About one-fourth of oil teocliers combined reported 
low ogreement omong stoff or thot there hod been no discussion of the 
progrom . 

Just less thon holf of all respondent groups except the central office stoff 

reported thot principols understond the problems of teochers in implementing 
the progrom to a very greot or consideroble extent. Thirty-four to 50 per" 
J cei.t of the teochers in eoch school cotegory soid those problems were 

ottended to to o very greot or consideroble extent; 62 to 78 percent of 
other District stoff soid the some . 
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D> Afeos Needing Change 

The fermenf ir. education o$ well as the criticisms of it ^ ore oriented toward " 
improvement ♦ in asking teachers and other School District staff to present their views of 
the Title I and Model Cities progroms, jt Is oppropriate to inquire what suggestions for 
change they hove. One cjuestion was designed to solicit their opinions about change in 
a number of things which Icoders in the progran-is thought respondents might wish to com- 
ment on . 

tn Table IV- 12 ore listed a series of jobs or roles which are involved in the pro~ 
grams. Respondents were asked to indicate to what- extent they would moke changes in 
those roles, Ir is not possible fo tell the kinds of clionges they would make, only the 
amount* (Unforiunately ^ not everything can be learned through a questionnaire with 
45 items,) 

It appears that the majority of respondents (in ail cases but one) do not see need 
forxhange to o very great or consideroble exten*". However, oi least one teacher in five 
believed that much chonge was needed in all jobs. 

Tne data In the table 5ugge:>t that teachers/ generaHy^ are more likely than olber 
groups to r-ioort tho!' they would poke larr;r.^ ch.ttnrK.:-. PriDc^pnls seem to be. more like the 
teachers then reading specicilists or cenirce ofuce sioli' i;* il jo raCjCrd, should be noted 
that the small number of respondents; in some groups^ especially principals and central office 
staff^ require that most sioternents of difference be made tenfofiveiy u) 

Model Ciiiei reaulicv::^ ore Lvr^:-t-*!iLc!y W^on oilu;;" ieoc^htir:: \o indicaie that they would' 
change things with instructional §ecretc7ries and wit!) math/science ofdes. More of them 
thon PTi '.^achers y/g;.^kl make large changes regarding Icnguoge de^^elopment/speech . , 
teacher:.^ ond moro' Model Cities tedchcis tlvon Titje I teachers v/ould moke such changes 
regarding ciassroom aides, . ^ 

There oppeors to [)e o concentration -'>l^ J^plj^^-'l'^'-ly high percentages of teachers 
and reading specialists wfio indicate tjiot they v/ould make large changes regarding math/ 
science oidcs* 
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In the some question, respondents were asked about changes they would make 
in the reading materials used and in the Resource Center. The results are presented in 
Table IV^IS. In most cases the majority would not change things to a very great or con- 
siderable extent. However, 62 percent of the PTI teachers and 73 percent of the princi- 
pals would make that much change in the resource centers. 

Looking across respondent groups, about 24 percent would change reading 
mc*i;rials to a very greet or considerable extent. Not shown in the table, but of interest, 
about 2J percent of all persons responding would not change reading materials at a||« 

To summarize changes proixjsed in that question, a quarter to a third of all 
respondents would not make any changes. Generally, 20 to 30 percent proposed very 
great or considerable change. The role which more people suggested they would make 
very great or considerable change in was that of the math/science aide. It appears that 
PTI teachers and principals are more likely to desire change in resource centers. 

Respondents were invited to write in other suggestions for change. A wide variety 
of suggestions were mode. Among those made by four or more were these: 

Training parents to help their children at home 

Reduce class size 

Provide more materials 

Insure program implementation 

Include all students in program activities 

Increase teacher competence, autonomy, and/or expectations of children 
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V. IMPLICATIONS AND RECOMMENDATIONS 



The evaluators have had experience in other settings wUh some of the problems 
of systematic program development. They also have had opportunity over several years 
to become acquainted with some of the frustrations of program development and evalua- 
tion in the Division of Urban Education • They have a fair amount af understanding of 
evaluations of compensatcrry education done on a national level. From that context and 
because af the excellent cooperation of the Urban Education staff, a few suggestions about 
the relation of program development and evaluation will be added. 

1 . Select a modest set of goals that are very important for students to attain; 
then carefully, regularly, and early in the process, assess student progress 
toward those goals. 

The leaders of the Division acted fairly early in the existence of the Division to 
collect ITBS data on o regular basis. This collection made possible the present evalua- 
tion. It also made data available for teachers, principals, and others to regularly 
examine student progress and to consider program effectiveness. 

However, those persons who may have wanted information regarding student 
progress in areas not covered by the ITBS such as student self esteem — could not 
examine data much beyond anecdotal remembrances or general impressions. Thus, the 
goals selected must be diverse enough to reflect both the particular skills of basic 
learning tools and some core attitudes or orientations, such as self esteem. 

The instruments and/or procedures used to evaluate progress should be well- 
developed and seen as appropriate by program staff. Although satisfying evaluation is 
never cheapo, costs can be controlled by careful design and judicious sampling. 

Comparisons are necessary for most evaluations, thus the data regarding the 
selected goals should be collected in all programs, preferably District wide# The 
present evaluation was limited in some ways by the absence of comparable data from 
schools other than those in the Title I program. Satisfying program evaluation will be 
difficult unless coordinated efforts are made in the whole District. 

At least some of the data in all programs should be collected by skilled data 
collectors who have no allegiance to one particular program but who have a real concern 
for students, teachers, and educational effectiveness. When one examines the fluctua- 
tions in school averages from year to year, as shown in Figures II hi through II h8 
(pages 38 to 58, passim.), one cannot lielp but wonder to what extent fhose differences 
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result from variation in test administration rather than from variations in student per- 
formance. 

Since the early stages of the implementation ot a new program typically involve 
organization, orientation, and teacher training, early e/ali ation should probably focus 
on those activities, making it possible to liave feedback jn the extent to which they are 
progressing as intended. 

2. Link evaluation together with program development, initiation, and 
implementation . 

Clearly, evaluators need to have enough Independence of program leaders to 
enable them to do their work well. At the same time, If evaluation is to be relevant to 
the program, and if its results are to be used, the planning, initiation, and implementation 
of both must proceed in concert. There did not appear to be any evidence of conflict 
among these functions at administrative levels in the Division of Urban Education, Yet, 
it appears that more examination of the data, involving teachers and reading specialists, 
might permit generation of teaching alternatives as well as facilitate communication 
abou -difficulties in carrying out the program. Such sessions might also reduce the nego" 
tive perceptions of some teachers regarding the tests and their use. Such interchange 
should aid evaluators in developing more meaningful measures and reports. 

This kind of an approach requires that there be time and arrangements for evalua- 
tion and program staff members to meet, discuss data, and plan alternative program and 
evaluation activities. 

r 

3. Encourage thoughtful experimentation. 

There is an absence of convincing, conclusive data about any given set of edu* 
cational activities which can be depended on to consistently produce desired student out~ 
comes for all students with all teachers In all communities. Educational activities need 
to be selected and adapted in terms of the particular mix of students, teacher charac" 
teristics, and classroom conditions which come together in a particular classroom. 

Perhaps one approach would be to (1) clarify the objectives, and the procedures 
for evaluating progress toward them; (2) define the shared responsibilities of students, 
teachers, principals, specialist/consultants, and parents for attaining them; and (3) then 
encourage teachers to execute their own approach. By giving the teachers all the support 
possible and by examining with them the results of assessments of student progress, perhaps 
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the things which "work" and "don't work" for a given teacher with o given set of stu- 
dents in a given set of circumstances can emerge rrore clearly, and result in improved 
student outcomes* 

Such an approach would not be easy. Parental involvement would be Important. 
Principals, specialists, consultants, teachers, and others would have different and 
demanding responsibilities. But some such approach which maximizes the opportunity 
and the responsibility of the people working directly in the learning situation^ while 
giving them genuine material and psychological support, might maximize strengths and 
permit growth of all concerned. 

4. Promote shared understandings and problem solving omong staff in different 
roles. 

This eval uation did not bring to the surface evidence of major tensions among 
people in various roles. The survey did give evidence that the views of teachers appear 
less optimistic than those of specialists and central office staff fairly often* These dif" 
ferences in views may be a factor affecting program implementation and educational 
improvement. 

Early in the irnp^erof-n' ./'ion of \hv "^lili-^ i pffort... in re(X*ljng, "^he central office 
staff initiated in-service training activities which brought together teachers from various 
schools. Comments by central office staff indicated they felt these w^re vital in initiating 
the program. Occasional comments received by the ICS staff from teachers in recent 
years indicated that tfiese in -service training rrocHngs promoted a sharing of ideas and 
problems and also permitted some adaptation to unique difficulties so that teachers were 
enabled to be more effective. 

One of the major issues brought forward in the questionnaire is the v>He*spread 
dissatisfaction with the recently implemented federal guidelines which require Title I 
resources to be expended only on those students who have demonstrated exceptional 
need for that assistance. Since it appears to be true that no change can be brought 
about at least in the near future — in federal policy, consequences of that po)icy in 
the schools should be t'loughtful ly reviewed. It may be that sv'oys can be found to 
ameliorate those consequences v^hich are negative. 

Reaularl/ scheduled sessions intended to promote examination of problems arising 
the implementation o' program huch as \ho eligibility issue could Increase aware- 
nesii of \he coordjn ic - , :<;ncrence, ligistical, ond attitudinol problems, permit more 
saMsfyIng rose iutio-^^.s, ::nd piomote more of a sense of coliesion among the instructional staff* 
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APPENDIX A 
QUESTIONNAIRES 

The questionnaire "Educators Views on Title I or Model Cities Programs" 
was requested respectively from staff according to type of program 
operating within their school. 
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April 25, 1973 
Tl 



EDUCATORS VIEWS ON TITLE I PROGRAMS 



In order for the answers to this questionnaire to be grouped for analyses in various ways, 
e.g., by amount of experience, categories of school worked in, etc., we need the follow- 
ing kinds of information from you. Please check below each of the items that applies to yoUi 



[7] 



Are you a teacher, principal, or other? (Please check one) 

(1) Teacher 

(2) Principal 

(3) Other administrator 

(4) Reading specialist in a school 

(5) Consultant/coordinator 

(6) Other (please write title) 



[6] — 



With which of the following categories of schools are you associated? (Check one) 

{]) Category I (Attucks; Douglass; Franklin (Benjamin); Garrison; Karnes; 

Phillips; Swltzer; Washington; Woodland; Yates) 

(2) Category II (Dunbar; Franklin (C.A.); Greenwood; Holmes; Llnwood; 

Richardson; Wheatley; Yeager) 

(3) Category III (Bancroft; Grace land; Longfellow; Mann; Meservey) 



How long have you been In yjur present 
school? 



[8] 



.(1) 
_(2) 

.(3) 
.(4) 
(5) 
(6) 
(7) 



year 

years 

years 

years 

years 

years 

or more years 



[9] 



[10] 



Have you taught In a Category II school 
since 1965? 



If you are now teaching In a Category I 
school, have ycu taught in any of the 
others In that category since 1965? 

(1) No 
—(2) Yes 

IF YES, about how many years? 

(1) 1 year 

[ (2) 2 years 

(3) 3 years 

(4) 4 years 

(5) 5 years 

(6) 6 years 

(7) 7 years 

Have you taught in a Category III school 
since 1965? 



[11] 



(1) No 
"(2) Yes 



[13] — : 



[12] 



IF YES, about how many years? 

1 year 

2 years 



_(2) 

(3) 3 years 



O ■ 
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(4) 4 years 
1(5) ' 

_(7) 7 years 



[14] 



5 years 

6 years 



(1) No 

(2) Yes 



IF YES, about how many years? 



(1) 

(2) 
(3) 
(4) 

"(5) 
"(6) 
(7) 



year 

ye( rs 

years 

years 

years 

years 

years 



I 



From your understanding of the Title I Program, hov^ important do you feel each 
of the following goals is to the purposes of that program? (Check one on each line) 



Intended Goals 



Student Achievement in 

Reading 

Arithmetic 



Science 
T hinking 
S^tudy ski I 



Student's 

Self image (self esteem) 
^THty to work with 
others in school 



Teacher*s 

Instructional skills 

Understanding of children 



Sense oF" competence 



Very 

Important 

Goal 

(1) 



Faculty 

Relationships among the 
total school faculty 



Parent's 
Intere st 
Su pport 



Farticipation 



Community 
In terest 
^pport 



Farticipa tion 



Others 

Please write here any other 
goals you believe relevant. 



Quite 
Important 
Goal 
(2) 



Fairly 
Important 
Goal 
(3) 



Is Not 
a Goal 
(4) 



I have no 
Information 
(5) 



[15] 
[16] 
[17] 
[18] 
[19] 

[20] 
[21] 

[22] 
[23] 
[24] 



[25J 

[26] 
[27] 
[28] 

[29] 
[30] 
[31] 



[32- 
33] 
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2. From your experience, to what extent do you feel the effectiveness (success) of the 
Title I Program depends upon each of the following? (Check one on each line) 



Reading materials used 


To a 
Very 
Great 
Extent 
(1) 


To a 
Consi- 
derable 
Extent 
(2) 


To 

Some 
Extent 
(3) 


To a 
Very 
Little 
Extent 
(4) 


Not 
At 
All 
(5) 












Instructional resource center 












Library resource center 
(in school) 












Administration (above 
principal) 












Principal 












Reading specialists 












Matn/bcience specialists 












Language development/ 
speech teacher 












Classroom teacher 












Classroom aides 












Reading aides 












Laboratory aides 












Parental involvement 












ln"serv!ce training 
For teachers 












For aides 












For parents 












Other: Please write in 
space below , 









































































[34] 
[35] 

[36] 

[37] 
[38] 
[39] 
[40] 

[41] 
[42] 
[43] 
[44] 
[45] 
[46] 

[47] 
[48] 
[49] 



[50- 
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3. Were you working in a school at the time the Sullivan or EDL Reading Program was 
first introduced into it? (Check one) 

(1) No ~ IF NO, GO TO Q. 5. 
f53] (2) Yes 

11^ YES: What did you think of the program that first year? (Check one) 

(1) Very eager to start the program 

[54] (2) Eager 

(3) Doubtful, though willing to try 

(4) Somewhat opposed to the program 

(5) Very opposed to the program 

4. In your opinion, what did most teachers think of the program that first year? (Check one) 

(1) Very eager to start the program 

(2) Eager 

(3) Doubtful, though willing to try 

[55 J (4) Somewhat opposed to the program 

(5) Very opposed to the program 

5. In vour opinion, how do most teachers feel about their ability to carry out the 
Title I Program after a year or two in it? (Check one) 

(1) Very confident 

(2) Quite confident 

[56] {3) Fairly confident 

(4) Not too confident 

(5) Not at all confident . 

6. In your opinion, what do most teachers who have had a few years experience with the 
Title I Program think about it? (Check one) 

(1) Most are very favorable toward it 

(2) Favorable 

[5 7] (3) Neither favorable nor unfavorable 

(4) Unfavorable 

(5) Most are very opposed toward it 

7. When you think about teachers who left Title I schools where you have taught, 
about now many would you estimate left the Program because they did not like it? 
(Check one) 

(1) Probably less than 20% 

(2) 20 to 39% 
[58] (3) 40 to 59% 

~(4) 60 to 79% 

(5) 80% or more 

(6) Don't know 
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8. Thinking back over your experience with the Title I Program, did you get the 
impression that administration principals, supervisors, central office administrators — 
were in agreement about the desirability and importance of the Title I Program? 
(Check one) 

(1) To a very great extent 

(2) To a considerable extent 

^ (3) To some extent 

(4) To a very little extent 

(5) Not at all 

(6) Do not hove sufficient information 



9. In your opinion, to what extent is there agreement among most of the staff in your school 
about what the Title I Program is supposed to accomplish? (Check one) 

(1) To a very greot extent 

(2) To a considerable extent 

[60] (3) To some extent 

^(4) To a very little extent 
^(5) Not at all 
(6) There has been no discussion of the program 



10. In your opinion, does the Title I Program require teachers to do different things 
or do things differently from teachers in other programs? (Check one) 

[61] ~(2)Yes 

(3) I have worked with only one kind of program and cannot make a comparison 

IF YES: Which of the following things do you think ore different or are required 
to be done differently by teachers in the Title I Program? (Check all 
those you see as appropriate) 

[62] (1) Planning: written objectives 

[63] (2) Continuous pupil progress evaluation and reporting 

[64]- (3) Use of instructional materials 

[65] (4) Use of audio-visual equipment 

[66] (5) Diagnosing and prescribing 

[67] (6) In-service training participation 

[68] (7) Receiving continuous supervision 

[69] (8) Handling professional and lay visitors 

[70] (9) Other: P!ease indicate in space below 



[71-72] 



11, To what extent do principals understand the problems which teachers have in carrying 
out the Title! Program? (Check one) 

(1) To G great extent 

(2) To a considerable extent 

[73] {3) To some extent 

(4) To a very little extent 

(5) Not at all 



12. To what extent do members of the reading staff who are not based In the schools under- 
stand the problems which teachers have in carrying out the Title I Program? 
(Check one) 

{]) To a grept extent 

(2) To a considerable extent 

[T4] (S) To some extent 

{4) To a very little extent 

(5) Not at all 

13. To what extent have the problems been attended to which teachers have had in carry- 
ing out the Title I Program? 

{}) To a great extent 

(2) To a considerable extent 

j75j (3) To some extent 

{4) To a very little extent 

(5) Not at all 

14. Do you have an aide or have you had an aide? (Please check one) 

(l)No 
[8] —(2) Yes 

IF YES: As you understand it, in terms of the Title I Program, what are the 
main things your aide is (was) supposed to do? (Check all appropriate activities) 

[9] (1) Monitor pupils 

[10] H; (2) Tutor 

[ll].- (3) Reinforce instruction 

[12 ] (4) Read alou<jl 

[13] (5) Set up audio-visual equipment 

14] (6) Make instructional materials available 

15] (7) Distribute instructional materials from room to room 

16] (8) Attend to daily routine 

[17] (9) General housekeeping chores 

[18] (10) Check test papers 

[19] (11) Other activities: (Please write in other activities in space below) 

[20-22 ] . — 



15. To what extent does (did) your aide do these things? (Check one) 

(1) To a very great extent 

(2) To a considerable extent 

[23] 2 (3) To some extent 

(4) To a very little extent 

please write any comments in space below. 
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16. Concerning reading programs, does the Sullivan or EDL Reading Program require more 
teacher effort than a basal program, such as Scott Fore$man? (Check one) 

(1) Much more effort 

(2) More effort 

[241 Z. i^) About the same 
(4) Less effort 

(5) Much less effort 

(6) I have not worked with both kinds of programs 

Please write any additional comments in space below. 



17. In your opinion, is the Sullivan or EDL program more difficult for children 
than basal programs, such as Scott Foresman? (Check one) 

(1) Much more difficult 

(2) More difficult 

[25] (3) About the same 

(4) Less difficult 

{5) Much less difficult 

(6) I have not worked with both kinds of programs 

18. Do you feel that the Sullivan or EDL Reading Program provides a better picture of 
the child's daily reading progress than the Scott Foresman or other basal reading 
programs? (Check one) 

(l)No 

[26] 11(2) Yes 

(3) I have not worked with both kinds of programs 

Please write any additional comments in space below. 
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19. Were you in the Title 
127] 



Program at the beginning (in 1970-71)? (Please check one) 



(1) No — IF NO, GO TO Q. 20 

(2) Yes 



IF YES: How much Influence at the beginning of the Program (just prior to 1970-71) 
do you think each of the groups or individuals had on planning and imple- 
menting the Title I Program? 



Federal guidelines 


A very 

great 

deal 

(1) 


A 

great 
deal 
(2) 


i^uite 
a bit 
(3) 


Some 
(4) 


Very 
MitHe 
(5) 


L/on 1 
know 
(6) 














TheSuperintendent 
(Mr. nazleTT) 














Assistant Superintendent 
for Urban Education 
(Mr. Wheeler) 














III ft L* 

Urban Education 
Evaluation (Mr. Mayberr 














Principals 
(Urban Education) 














Parents 














School Board 














Reading Supervisor 
(Mrs. 1 nomas; 














Teachers 














ixeociing ^lati 














Others: Please write 
others below 







































































[28] 
[29] 

[30] 

[31] 

[32] 
[33] 
[34] 

[35] 

[36] 

[37] 

[38-40] 
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20. Hovi much influence would you soy each of the groups or individuals fisted below have 
on the general day-to-day operation of the Title I Program? (Please check one on 
each line) 



rcQ6ra i oui ae i ine5 


A very 

great 

deal 

(I) 


A 

great 
deal 
(2) 


Quire 
a bir 

(3) 


Some 
(4) 


Very 
little 
■(5) 


Don't 
know 
(6) 














School Boord 














The Superintendent 














Asssisranr ouperinTenaenT 
for Urban Education 














Assistant Superintendent 
for School Management 














Director of Elementary 
uuucari on 














Principal 














Reading Supervisor 














Reading Consultants 














Reading Teacher 














Classroom Teacher 














Urban Education 
Evaluation 














Parents 














Community Organiza- 
tions 














Others: Please wiite 
below 






• 
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21. Dj you feel there were enough ''human resources" (aides, insfrucHonal secretaries, 
specialists, etc.) provided to enable teachers to carry out the Title I Program 
successfully? (Check one) 

{]) More than enough 

(2) Enough 

[58] (3) Not quite enough 

( 4) Much less than enough 



22. Do you feel there were enough books, work books and other instructional materials 
for teachers to carry out the Title I Program? (Check one) 

(1) More than enough 

r^Q, (2) Enough 

l-^^J (3) Not quite enough 

(4) Much less than enough 

23. Do you feel the facilities (classroom equipment, space, etc.) were adequate for 
carrying out the Title I Program? (Check one) 

(1) Very adequate 

(2) Adequate 

p (3) Not quite adequate 

1 60] ~(4) Inadequate 

(5) Very inadequate 

24. Thinking about the in-service training provided for people who are to carry out the 
Title I Program, how do you feel about the amount of training provided? 
(Please check one) 

(n Much more was provided than was needed 

(2) Somewhat more was provided than needed 

[61] (3) The right amount was provided 

(4) Not quite enough was provided 

(5) Much less was provided than needed 

25. In your opinion, was the kind of training provided in Title I oppropriate for 
what was required for carrying out the program? (Check one) 

(1) Very appropriate 

(2^ Quite oppropriate 

[62] (3) Somewhat appropriate 

(4) Inappropriate 

(5) Very inappropriate 

Write ony comments here 
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26. Has student "turnover" in your present school been a problem? That Is, has the arrival 
and departure of students during the school year — or between years — been a source of 
difficulty? (Check one) 

(1) Student turnover is a very big problem 

(2) A big problem 

^3 J (3) Is somewhat a problem 

(4) Not much of a problem 

(5) Student turnover has been helpful rather than a problem 



27. In your opinion, how much do most school staff members expect of the students in the 
Title I Schools? (Check one) 

(1) Much too much 

(2) Too much 

[64] (3) About right 

(4) Too little 

(5) Much too little 



28. In your opinion, to what extent has Title I brought about improvement in each of 
the following things? (Please check one on each line) 



Human resources 

Availability of specialists 
(e «>g. , in reading) 



Availability of assistants 
(e.g., instructional 
secretory^ aides) 



Material resources 

Materials for pupil use 
(books^ workbooks, etc.) 



Catalogs of locally pre" 
pared worksheets and 
teaching aides 



Instructionol focilities 
Instructional Services 
Center 



Resource Centers 



Loboratories 



Multimedia (audiovisual, TV, 
listening c enters) 

Ciner 



To a 
Very 
Great 
Extent 

(1) 



To a 
Consi- 
derable 
Extent 
(2) 



To 

Some 
Extent 
(3) 



To a 
Very 
Little 
Extent 
(4) 



Not 
At 
All 
(5) 



[65] 
[66] 
[67] 
[68] 

[69] 

[70] 
[71] 

[72] 
[73-75] 




n 



END OF 
CARD 2 



29. In your opinion, to what extent has Title I brought improvement in each of the 

following things? (Please check one on each line) BEGIN 

CARD 3 



Student Achievement ir 
Reading 



Arithmetic 
Science 



jhmking 
St udy Skilir 



Student's 

Self image (self esteem) 



Ability to work with 
others in school 



Teacher's 

instructional skills 



Understanding ot 
children 



?ense of competence 



Faculty 

Relationships among the 
total school faculty 



Parent's 
Interest 



bupport 
Porticipation 



Community 
Interest 



Su pport 
Forticipation 



Others: Please write here 
any other areas you 
believe relevant: 



To a 
Very 
Great 
Extent 

(1) 



To a 
Consi- 
derable 
Extent 
(2) 



To 

Some 
Extent 
(3) 



To a 
Very 
Little 
Extent 
(4) 



Not 
At 
All 
(5) 



[8] 

[9] 
[10] 
[11] 
[12] 



[13] 
[14] 

[15] 

[16] 
[.17] 

[18] 



[19] 
[20] 
[21] 



[22] 
[23] 
[24] 



[25-27] 
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30. If you could make changes In the Instructional program in Title I schools, how 
much would you change each of the following? (Please check one on each line) 



The reading materials used? 


To a 
Very 
Great 
Extent 
(1) 


To a 

Consi"" 

derable 


To 

Some 


To a 
Very 
Little 
E^^^nt . 


Not 
At 

A 1 1 












The reading specialists/ 
consultants in the schools? 












^Language development/ 
speech teachers? 












Instructional secretaries? 












Math/science aides? 












Classroom aide3? 












Teaching aides? 












Laboratory aides? 












Meetinas with other teachers 
regarding the program? 












Resource Center? 












Parental involvement? 


- 










In"service training 
for teachers? 












for aides ? 












tor parents? 












Other? (please write in 
below) 









































































[28] 
[29] 

[30] 
[31] 
[32] 
[33] 
[34] 
[35] 

[36] 
[37] 
[38] 

[39] 
[40] 
[41] 

[42-44] 



31. What other changes would improve the education offered children in Title I 
schools? (Please write in space below) 

[45-47] 
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32, Would you soy that the way the Title I Progranr, was organized and operated this 
year ~ with eligibility depending on individual students rather than schools — is better 
for children than the way it worked !n previous years? 

(1) Much better 

(2) Somewhat better 

(3) About the same 

[48] (4) Not as good 
(5) Much poorer 

(Please write in the reasons for your view here) 



33. Please write any additional comments about Title i in the space below. 



[49-50] 



34, In your opinion, should there be one reading program throughout the School District? 
(Check one) 

(l)No 

[51] (2) Yes 

Why? Please indicate below the main reasons for your answer. 



[52-53] 



35 • Do you think a teacher should be permitted to choo^,from two or three alternative 
type programs, the reading program to be used in her/his classroom? (Check one) 

(1) No 

[54] ZI(2)Yes 

what are fhe main reasons for your answer? Please write in space below. 

[55-56] 
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'36. Which of the following reading programs would you prefer to use? (Please check one) 

(1) Scott Foresman 

(2) Sullivan 
[57] 11(3) EDL 

(4) A combination 

(5) Other (Please write in space below) 



[58-59] 



37. To what extent can a teacher make modifications in the present reading program in 
her/Viis classroom? (Check one) 

{]) To a very great extent 

{2) To a considerable extent 

[60] (3) Jo some extent 

(4) To a very little extent 

(5) Practically none 

38, Do you think it would help a program to be more effective to arrange it so that only 

teachers who are receptive to, or in favor of, that program be allowed to work in it? (Check one) 

(1) Very helpful in making programs more effective 

(2) Quite helpful 
[61] " (3) Fairly helpful 
(4) Not so helpful 

(5) Not at all helpful in making programs more effective 



39. During the time you have been in your present school, how much influence have parents 
hod on the activities of the school? (Check one) 

( 1) A very great deal 

(2) A great deal 

[62] (3) Seme 

(4) Not very much 

(5) None or almost none 

(6) Don't know 

40. During the time you have worked in your present school, how much influence have 
members of the immediate community (other than parents) had on the activities of the 
school? (Check one) 

(1) A very great deal 

{2) A great deal 

[63] (3) Some 

(4) Not very much 

(5) None or almost none 

(6) Don't know 
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41. In general, do you think the educational programs (Title I, Title II, Title III, NDEA, 

Model Cities, etc.) paid for by the federal government have been good for the children? 
(Please check one) 

(1) Very good 

(2) Quite good 

[64] (3) Fairly good 

(4) Not good ' 

(5) Bad 

Please write any comments below • 



[65-66] 



42. In your opinion, what would be the consequences for children now in those programs 
of discontinuing categorical programs for education (such as TltTe I and Model Cities)? 
(Check one) 

(1) Students now involved would suffer 

[67] (2) Students now involved would not be affected much 

(3) Students now involved would benefit 

Please write any comments below. 



43. In your opinion, what would be the consequences for children not now in those pro 
grams of discontinuing them? (Check one) 

(1) Students not now involved would benefit 

(2) Students not now involved would not be affected much 

i"^J (3) Students not now involved would suffer 

Please write any comments below. 



ERIC 



16 



44. It has sometimes been observed that achievement for some students seems to slow down 
about the time they are in the fourth grade. From your experience with elementary 
students what explanations would you give for some students slowing down at about 
that grade? (Check appropriate ones below) 

[69] (1) Increased difficulty of school work 

[70] J,2) Accumulated deficiencies in previous work 

(71] (3) Less emphasis on teaching reading in earl ier grades 

[72] (4) Peer pressures 

[73] (5) Home pressures 

[74] (6) Perception of school as irrelevant 

[75 J (7) Other: (Please write in space below) 

[76-77] ^ 



45. If you had your choice, in which kind of school would you prefer to work? 
(Please check one) 

[78] (1) School now in 

( ) Another school 

If "Another school" 

(2) Title I 

(3) Model Cities % 
[79] (4) School without Federal program % 

{5) Other (Please write in space below) 



Thank you for helping in the study regarding Title I and Model Cities. 

Please place the questionnaire in the ICS envelope provided, seal the envelope, 
and return it to the reading specialist in your school. 
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